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EXECUTIVE SUMMARY 



Richard J. Tannenbaum, PhD and Michael Rosenfeld, PhD 
Educational Testing Service 



INTRODUCTION 

In 1987 the American Speech-Language-Hearing Association (ASHA) commissioned a job analysis 
study to delineate the tasks, knowledge, and skills underlying the practice of audiology and speech-language 
pathology, respectively. The purpose of that study * was to evaluate the requirements for the Certificates of 
Clinical Competence awarded by ASHA in these two professional areas; that is, to determine the extent to which 
the requirements were related to the knowledge and skills needed for competent, entiy-level professional practice. 



Then in 1994, responding to the changing nature of professional practice, ASHA commissioned 
Educational Testing Service (ETS) to conduct an independent Job analysis study of the practice of audiology. 

The purpose of that study was to modify and update the audiology performance domain identified in 1987 so that 
it accurately reflected the current state-of-the-art in audiology. This report describes the job analysis study 
conducted by ETS. It documents both the methods used in developing the performance domain of audiology and 
the analyses conducted to verify the importance of the performance domain; it also presents the results of these 
and related analyses, and the implications of the study outcomes for standards modification, curriculum redesign, 
and test development. 

Job Analysis 



Job analysis refers to a variety of systematic procedures designed to obtain descriptive information about 
the tasks performed on a job and/or the knowledge, skills, and abilities thought necessary to perform those tasks 
(Arvey & Faley, 1988; Gael, 1983). A job analysis is the primary mechanism for establishing the job-relatedness 
of decisions concerning standards and curriculum redesign and professional certification. That is, if certification 
standards and curriculum can be directly linked to the outcomes of a job analysis, they may be said to be job- 
related. Similarly, if the content of a certification test can be directly linked to the outcomes of a job analysis, it 
may be said to be job-related, and inferences from test scores may be supported by arguments of content validity. 
The rationale that supports the content of certification standards, curriculum, and certification tests is the 
demonstrable linkage that exists between each and the performance domain of the associated occupation or 
profession. 

Professional standards and legal precedents recommend that a job analysis include the participation of 
various subject-matter experts (Mehrens, 1987) and that the information collected be representative of the 
diversity within the occupation (Kuehn, Stallings, & Holland, 1990). Diversity refers to regional or job context 
factors and to subject-matter-expert factors such as race or ethnicity, experience, and sex. The job analysis 
conducted to define the performance domain for newly certified audiologists was designed to be consistent with 
the Standards for Educational and Psychological Testing (American Educational Research Association et al., 
1985) and current professional practice. 



‘ Greenberg, S., & Smith, I. L. (1987). Evaluation of the Requirements for the Certificates of Clinical 
Competence of the American Speech-Language-Hearing Association . New York: Professional Examination 
Service. 
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Overview of the Job Analysis Methodology 



The job analysis described in this study involved a multi-method approach that included a panel of 
subject-matter experts and a large-scale survey of practicing audiologists as well as educators of and supervisors 
of audiologists. The panel consisted of 14 experienced and accomplished audiologists working in a variety of 
settings (e.g., university, private practice, hospital). These experts also had representation by gender, 
race/ethnicity, and geographic region. The primary responsibility of the expert panel was to define the 
performance domain of a newly certified audiologist. This domain (defined by the panel to consist of task 
statements and knowledge areas) served as the content of the job analysis survey. This survey was then 
administered, by mail, to 3,612 practicing audiologists, 260 educators (academic and clinical directors of 
audiology programs), and 420 clinical-fellowship supervisors ^ These survey recipients were asked to make 
three judgments: First, they were asked to rate the importance of the clinical activity statements and knowledge 
areas for newly certified audiologists. Next, they were asked to identify where the clinical activities and 
knowledge areas are learned by newly certified audiologists. Finally, they were asked to identify where the 
clinical activities and knowledge areas should be learned by newly certified audiologists. The judgments of those 
responding to the survey were then analyzed to identify core clinical activities and knowledge areas. That is, 
clinical activities and knowledge areas that all groups (practicing audiologists, educators, and supervisors) and 
subgroups of practicing audiologists (defined by practice setting, years certified, educational degree, sex, gender, 
and geographic region) rated to be important. Judgments were also analyzed to determine if, and where, there 
were discrepancies between indications of where the clinical activities and knowledge areas were learned and 
where they should be learned. 



DATA ANALYSIS OF SURVEY RESPONSES 

Analyses were conducted separately for each of the three groups of survey respondents: practitioners, 
educators, and clinical-fellowship supervisors. These group-level analyses were followed by a series of subgroup 
analyses. That is, the practitioners were partitioned into subgroups defined by their responses to background 
information. The following six subgroups were created: gender, race/ethnicity, geographic region, years 
certified, practice setting, and educational level. Both levels of analyses are critical to ensure the job-relatedness 
and fairness of the decisions that will be made based upon the outcomes of this job analysis study. 

To assist in the interpretation of the survey results, criteria (cut-points) were established to differentiate 
more relevant or appropriate clinical activities and knowledge areas from less relevant or appropriate clinical 
activities and knowledge areas. Clinical activities and knowledge areas not meeting one or more of the criteria 
were flagged and should be reviewed by the members of the Standards Council. Cut-points are decision rules 
that are set to assist in the accomplishment of certain objectives. They can vary depending on the purposes for 
which they are used. Cut-points can be more stringent for some purposes than for others. For example, cut- 
points used to identify content for use in high-stakes certification examinations need to be set at a higher level 
(to defend in the event of litigation) than cut-points set for use in curriculum development (a lower stakes use of 
the results). Cut-points need to be set so they are consistent with legal and professional standards, provide 
adequate coverage of the domains in question, and are credible to the relevant constituencies. The cut-points that 
were set in this study and their rationales are provided below. 

• The first phase of analysis consisted of computing frequency counts of zero (0) responses to the 
importance scale for both clinical activity statements and knowledge areas. The zero response 
signified that a clinical activity was not performed by a newly certified audiologist and that a 
knowledge area was not needed by a newly certified audiologist. A clinical activity or knowledge 
area was considered part of the performance domain for entry-level audiologists if more than half of 
the respondents indicated that it was performed or needed (i.e., a non-zero response). Therefore, if 



Eighty percent of the educators had a doctorate in audiology. Also, although three groups were identified based 
on their main area of practice, we recognize that clinical-fellowship supervisors are practicing audiologists. 
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51% or more indicated that a clinical activity was not performed or that a knowledge area was not 
needed it was flagged. The 51% standard was selected for two reasons. First, it represents a majority 
opinion. It seems reasonable to argue that a clinical activity or knowledge area should be considered 
part of the performance domain of entry-level practice if at least half of the respondents indicate that 
it is performed or needed. Second, the standard is flexible enough to accommodate the array of work 
settings in which audiologists practice (e.g., hospitals, private offices, schools, and universities). Any 
chosen standard would need to allow for the potential variability of professional practice across work 
settings, while not inappropriately attenuating the performance domain. The 51% standard was 
selected because it satisfied these design requirements. 

• Next, mean importance ratings were computed for all clinical activity statements and all knowledge 
areas. The mean analysis was conducted to differentiate more important job content from less 
important job content. Clinical activities and knowledge areas with mean importance ratings of 3.50 
(the midpoint between the two scale points signifying moderately important and important) or higher 
were classified as more important. Clinical activities and knowledge areas with mean ratings less 
than 3.50 were flagged. Importance ratings play a critical role in the design of certification 
examinations. Professional and legal guidelines indicate that if content is to be included in a 
certification examination, the developer or user must be able to demonstrate that it is related to an 
important part of professional practice. The 3.50 cut-point is consistent with this requirement of 
demonstrating job relevance. Clinical activities and knowledge areas with a mean of 3.50 or higher 
may be considered for inclusion in a certification examination. Flagged job content, clinical activities 
and knowledge areas with a mean importance rating less than 3.50, should only be considered for 
inclusion, if the Standards Council can provide compelling, written justifications. The 3.50 cut-point 
is a conservative indicator of importance: it’s a more effective safeguard against the use of less 
important clinical activities and knowledge areas in defining the performance domain than other 
plausible cut-points, for example, 3.00, which still signifies that content is moderately important. 

It is worth reiterating that the 3.50 cut-point directly applies to decisions regarding certification 
examinations. It need not apply to decisions regarding curriculum development or redesign. As long 
as a clinical activity or knowledge area is judged to be part of the performance domain for entry-level 
audiologists, it may be included in curriculum-related decisions. In other words, if at least half of the 
respondents judged a clinical activity or knowledge area to be performed or needed, regardless of its 
mean importance rating, it may be used to inform curriculum development or redesign decisions. 

• The last set of analyses focused on determining if there were perceived discrepancies between where 
practitioners, educators, and clinical-fellowship supervisors said clinical activities and knowledge areas 
were learned and acquired, and where respondents said the clinical activities and knowledge areas 
should be learned and acquired . (Similar analyses were conducted for practitioners with five or less 
years certification and practitioners with more than five years certification.) A zero (0) discrepancy 
score signified that a clinical activity or knowledge area was being learned and acquired where 
respondents said it should be learned and acquired. A non-zero discrepancy score signified that a 
clinical activity or knowledge area was not being learned or acquired where it should be learned or 
acquired. If more than 25% of the respondents indicated that a clinical activity or knowledge area 
was not being learned or acquired where it should be (a non-zero discrepancy score), it was flagged. 
This cut-point was chosen to bring to the attention of the Standards Council clinical activities and 
knowledge areas that were judged by meaningful numbers of respondents — for example, 25% of the 
practitioners represents, on average, 298 respondents - as not being learned or acquired where they 
should have been. This cut-point was purposefully established to provide the Standards Council with 
the opportunity to consider relatively large numbers of clinical activities and knowledge areas. Given 
the impact that modifications to curriculum and certification standards may have on the profession, 
we believed it was critical to employ a cut-point value that would foster high levels of discussion. 
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SUMMARY OF RESULTS 



Frequency Analysis 

• Only one clinical activity statement (#11 — ’’Evaluate and document changes in the functional status 
of neural tissue or structures during operative procedures)” was flagged as not being part of the 
performance domain for newly certified audiologists. No knowledge areas were flagged. These 
results clearly indicate that the performance domain defined by the panel of subject-matter experts is 
job-relevant. The adequacy of the performance domain is further supported by the responses of 
practitioners, educators, and clinical-fellowship supervisors indicating that the clinical activities and 
knowledge areas did, in fact, cover what an entry-level audiologist should be able to do and know. 

Mean Analysis 

• There was a high level of agreement among the practitioners, educators, and clinical-fellowship 
supervisors in terms of their classifications of more important and less important clinical activity 
statements and knowledge areas. For clinical activity statements, the level of classification agreement 
was 97% for educators and clinical-fellowship supervisors, 93% for educators and practitioners, and 
97% for clinical-fellowship supervisors and practitioners. For knowledge areas, the level of 
agreement was 89% for educators and clinical-fellowship supervisors, 92% for educators and 
practitioners, and 96% for clinical-fellowship supervisors and practitioners. 

• Comparable levels of classification agreement were obtained for the subgroups of practitioners. 

• Twelve of 58 clinical activities (21%) were flagged by practitioners, educators, and clinical-fellowship 
supervisors due to a mean importance rating of less than 3.50; 28 of 118 knowledge areas (24%) were 
similarly flagged. 

• Six additional clinical activity statements and 10 additional knowledge areas were flagged by the 
subgroup analysis. 

• Across all respondent groups and subgroups, therefore, 40 of 58 clinical activity statements (69%) and 
80 of 118 knowledge areas (68%) were judged to be important (i.e., met or exceed the mean criterion 
of 3.50). 

Discrepancy Score Analysis 

• Educators did not agree with either practitioners or clinical-fellowship supervisors regarding perceived 
discrepancies between where clinical activities and knowledge areas are learned and acquired and 
where they should be learned and acquired. 

• Educators believed 91% of the clinical activities and 96% of the knowledge areas were being learned 
and acquired where they should be learned and acquired. In contrast, practitioners believed that only 
45% of the clinical activities and 48% of the knowledge areas were being learned and acquired where 
they should be learned and acquired. And clinical-fellowship supervisors believed that only 38% of 
the clinical activities and 39% of the knowledge areas were being learned and acquired where they 
should be learned and acquired. 

• An inspection of the discrepancy scores further revealed that respondents believed that clinical 
activities and knowledge areas should be learned and acquired earlier in the educational process. In 
particular, clinical-fellowship supervisors believed that 69% of the clinical activities they flagged, 
though learned during the clinical fellowship, should be learned in school. And practitioners believed 
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that 90% of the knowledge areas they flagged, though acquired after certification, should have been 
acquired in school. 

• Consistent with the group-level analysis, practitioners defined by their years of certification, indicated 
that clinical activities and knowledge areas should be learned earlier in the educational process. 

• In particular, practitioners with five or less years certification indicated that 66% of the clinical 
activities they flagged, though learned during the clinical fellowship, should be learned in school. 

• Practitioners with five or less years of certification indicated that 70% of the knowledge areas they 
flagged, though acquired after certification, should have been acquired in school. 

IMPLICATIONS 



The Modification of Certification Standards 



The current standards for certification in audiology consist of four components: (a) specific academic 
coursework and clinical coursework from an accredited program; (b) a graduate degree; (c) a 9-month, 
supervised clinical fellowship; and (d) passing a national examination. The results of this job analysis study may 
be used by the Standards Council as it considers modifying the current certification standards. We recommend 
that the Council first examine the clinical activity statements and knowledge areas defined by the panel subject- 
matter experts and verified by the survey results as being part of the performance domain for entry-level 
audiologists. Though we have applied certain criteria to evaluate the defined performance domain, it is 
ultimately the Council that needs to come to agreement in terms of what it considers to be important and relevant 
clinical activities and knowledge areas for entry-level audiologists. To this end, the Council may elect to apply 
its own criteria to the judgments obtained in this study as well as to consider the results of other studies or 
judgments made by other professional bodies. 

For purposes of standards modification, we invite the Council to examine the judgments regarding where 
clinical activities and knowledge areas are learned and acquired (Tables 12 and 13). These data provide valuable 
insights into the perceived appropriateness of the current professional education and training of audiologists. 

That is, the data nicely illustrate which clinical activities and knowledge areas are learned and acquired during 
the school-based experience, during the clinical-fellowship experience, and after certification. The Council may 
examine these data to determine if any clinical activities and knowledge areas that are reported to be learned and 
acquired after certification, for example, should be incorporated into either the school-based experiences or the 
clinical-fellowship experiences of audiologists. Also, the Council may benefit by reviewing the ratings provided 
in Appendixes J, K, and L that summarize where practitioner, educators, and clinical-fellowship supervisors 
believed clinical activities and knowledge areas should be learned and acquired in the educational process. The 
Council may use the latter ratings, as well, to determine if clinical activities or knowledge areas should be 
learned or acquired earlier in the process of professional education and training. Large-scale modifications to the 
scope or sequence of professional education and training may necessitate that the existing certification standards 
be reevaluated. 

The Redesign of Curriculum 

The job analysis procedures used in this study were sensitive enough to identify differences of opinion 
on the part of educators and the other two respondent groups concerning where clinical activities and knowledge 
areas should be learned. This input should be useful to educators and other decision-makers in redesigning or 
modifying curricula required for competent professional practice. More job-based communication between 
relevant stakeholders should help to improve the preparation and competence of newly certified audiologists. 
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We believe that these discussions should encompass the entire educational process. This could include 
what is taught at the bachelor’s level as well as the curriculum in graduate professional education. We believe, 
in particular, that there needs to be clear understanding and communication between educators and clinical- 
fellowship supervisors concerning the aspects of professional education and training that are to be provided by 
each group. The results obtained in this study indicate that clinical-fellowship supervisors expect graduates of 
professional schools to be able to perform more clinical activities and to know more content areas, before the 
start of the clinical fellowship. Recently certified audiologists also indicated that they believed many of the 
things they learned during their clinical fellowship should have been learned in school. It seems clear that both 
clinical-fellowship supervisors and practitioners believe that the school-based component of the professional 
education and training of audiologists should assume a more prominent role. This perceived need for a change 
in emphasis provides a solid basis for considering the redesign of existing curriculum. 

A study of curricula may be performed if judged to be appropriate and/or feasible. As an alternative 
approach, educators could be presented with the clinical activities and knowledge areas that the Standards 
Council believes reflect the core of professional practice and be asked to indicate where in their program these 
clinical activities and knowledge areas are taught. If they are not taught, educators could be asked to consider 
revising their curriculum to include this additional content. 

The Design of Certification Examinations 



Although this was not the main purpose of conducting the study, the results of the Job analysis can be 
used to design a certification examination. As noted above, those clinical activity statements and knowledge 
areas with a mean importance rating of 3.50 or higher should be considered the primary pool from which test 
specifications are built. Building test specifications requires the exercise of sound professional judgment. If test 
development committees composed of practicing audiologists decide that several of the clinical activity 
statements and knowledge areas that were not universally endorsed as being important must be included in the 
test specifications, then a compelling, written justification must be provided. Otherwise, the results of the job 
analysis study provide a sound defensible rationale for building test specifications. 

Test questions and formats need to be developed to measure each part of the test specifications. 
Questions written to those specifications need to be linked back to the specifications by the question writer as 
well as by an independent group of practitioners. Linkages from test questions to test specifications, and from 
test specifications to the job analysis, provide a strong network for use in documenting the validity of 
certification examinations. 



SHORT SUMMARY 

The results of this study indicated that practitioners, educators, and clinical-fellowship supervisors were 
in agreement in terms of the clinical activities and knowledge areas that form the performance domain for entry- 
level audiologists. Only one clinical activity ("Evaluate and document changes in the functional status of neural 
tissue or structures during operative procedures") was not considered part of the performance domain. All three 
groups were also in agreement in terms of their classifications of more important and less important clinical 
activities and knowledge areas; agreement in classification ranged from 89% to 97%. Finally, both practitioners 
and clinical-fellowship supervisors agreed that many of the clinical activities and knowledge areas should be 
learned and acquired earlier in the educational process than is currently the case. Educators, however, did not 
share this belief; they believed that most clinical activities and knowledge areas were being learned and acquired 
where they should be learned and acquired. The results of this study provide a solid foundation on which to 
base decisions regarding standards modification, curriculum redesign, and test development. 



TABLE OF CONTENTS 



EXECUTIVE SUMMARY 

INTRODUCTION 

Job Analysis 

Overview of the Job Analysis Methodology 

METHODS 

Build a Draft Performance Domain 

Assemble a Panel of Subject-Matter Experts 

Conduct a Meeting of the Subject-Matter-Expert Panel . . . 

Prior to the meeting 

During the meeting 

After the meeting 

Conduct a Pilot Test of the Job Analysis Survey 

Description of the Job Analysis Survey 

Administer the Job Analysis Surveys 

Select survey samples 

Mail surveys 

Data Analyses 

Levels of analysis 

Verification of responses 

Frequency counts of zero responses 

Mean importance ratings 

Content coverage ratings 

Discrepancy scores 

RESULTS 

Response Rates 

Respondent Demographics 

Practitioners 

Educators 

Clinical-fellowship supervisors 

Frequency Counts of Zero Responses 

Mean Importance Ratings: Clinical Activity Statements . . 
Practitioners, educators, clinical-fellowship supervisors 

Subgroups of practitioners 

Content Coverage: Clinical Activity Statements 

Mean Importance Ratings: Knowledge Areas 

Practitioners, educators, clinical-fellowship supervisors 

Subgroups of practitioners 

Content Coverage: Knowledge Areas 

Discrepancy Scores: Clinical Activity Statements 

Practitioners, educators, clinical-fellowship supervisors 

Subgroup analysis 

Discrepancy Scores: Knowledge Areas 

Practitioners, educators, clinical-fellowship supervisors 
Subgroup analysis 



O 




i 

1 

1 

1 

2 

2 

2 

2 

3 

3 

4 

5 

6 

6 

7 

7 

7 

7 

, 7 

8 

8 

. 8 

. 9 

. 9 

. 9 

. 9 

10 

11 

11 

11 

11 

12 

13 

14 

14 

14 

16 

17 

17 

18 

19 

19 

19 



vii 



IMPLICATIONS 



19 



The Modification of Certification Standards 19 

The Redesign of Curriculum 29 

The Design of Certification Examinations 30 

REFERENCES 32 



APPENDIXES 

A . Subj ect“Matter Experts 

B. Pilot Test Participants 

C. Pilot Test Questionnaire 

D. Job Analysis Survey [Practitioners] 

E. Frequency Counts of Zero Responses 

F. Mean Importance Ratings: Clinical Activity Statements 

Educators 

Clinical-fellowship supervisors 
Practitioners 

G. Mean Importance Ratings: Clinical Activity Statements — Practitioner Subgroups 

Gender 
Race/ethnicity 
Practice setting 
Years certified 
Highest educational level 
Geographic region 

H. Mean Importance Ratings: Knowledge Areas 

Educators 

Clinical-fellowship supervisors 
Practitioners 

I. Mean Importance Ratings: Knowledge Areas ~ Practitioner Subgroups 

Gender 
Race/ethnicity 
Practice setting 
Years certified 
Highest educational level 
Geographic region 

J. Discrepancy Scores: Clinical Activity Statements 

Practitioners 

Educators 

Clinical-fellowship supervisors 

K. Discrepancy Scores: Clinical Activity Statements 

Practitioners with five years or less certification 
Practitioners with more than five years certification 

L. Discrepancy Scores: Knowledge Areas 

Practitioners 

Educators 

Clinical-fellowship supervisors 

M. Discrepancy Scores: Knowledge Areas 

Practitioners with five years or less certification 
Practitioners with more than five years certification 




viii 



LIST OF TABLES 



Table 1: Rating Scales: Clinical Activity Statements 5 

Table 2: Rating Scales: Knowledge Areas 6 

Table 3: Rating Scale Anchors 6 

Table 4: Discrepancy Scores for Clinical Activity Statements 

and Knowledge Areas 9 

Table 5: Demographic Characteristics of Respondents 10 

Table 6 : Clinical Activity Statements that Failed the 3.50 Cut-Point 11 

Table 7: Percent of Agreement Within Subgroups: 

Clinical Activity Statements 13 

Table 8 : Content Coverage: Clinical Activity Statements 14 

Table 9: Knowledge Areas that Failed the 3.50 Cut-Point 15 

Table 10: Percent of Agreement Within Subgroups: 

Knowledge Areas 16 

Table 11: Content Coverage: Knowledge Areas 17 

Table 12: Where Learned: Clinical Activity Statements 21 

Table 13: Where Learned: Knowledge Areas 24 



ix 




1 



3 



1 



INTRODUCTION 

In 1987 the American Speech-Language-Hearing Association (ASHA) commissioned a job analysis 
study to delineate the tasks, knowledge, and skills underlying the practice of audiology and speech-language 
pathology, respectively. The purpose of that study * was to evaluate the requirements for the Certificates of 
Clinical Competence awarded by ASHA in these two professional areas; that is, to determine the extent to which 
the requirements were related to the knowledge and skills needed for competent, entry-level professional practice. 

Then in 1994, responding to the changing nature of professional practice, ASHA commissioned 
Educational Testing Service (ETS) to conduct an independent job analysis study of the practice of audiology. 

The purpose of that study was to modify and update the audiology performance domain identified in 1987 so that 
it accurately reflected the current state-of-the-art in audiology. This report describes the job analysis study 
conducted by ETS. It documents both the methods used in developing the performance domain of audiology and 
the analyses conducted to verify the importance of the performance domain; it also presents the results of these 
and related analyses, and the implications of the study outcomes for standards modification, curriculum redesign, 
and test development. 

Job Analysis 



Job analysis refers to a variety of systematic procedures designed to obtain descriptive information about 
the tasks performed on a job and/or the knowledge, skills, and abilities thought necessary to perform those tasks 
(Arvey & Faley, 1988; Gael, 1983). A job analysis is the primary mechanism for establishing the job-relatedness 
of decisions concerning standards and curriculum redesign and professional certification. That is, if certification 
standards and curriculum can be directly linked to the outcomes of a job analysis, they may be said to be job- 
related. Similarly, if the content of a certification test can be directly linked to the outcomes of a job analysis, it 
may be said to be job-related, and inferences from test scores may be supported by arguments of content validity. 
The rationale that supports the content of certification standards, curriculum, and certification tests is the 
demonstrable linkage that exists between each and the performance domain of the associated occupation or 
profession. 

Professional standards and legal precedents recommend that a job analysis include the participation of 
various subject-matter experts (Mehrens, 1987) and that the information collected be representative of the 
diversity within the occupation (Kuehn, Stallings, & Holland, 1990). Diversity refers to regional or job context 
factors and to subject-matter-expert factors such as race or ethnicity, experience, and sex. The job analysis 
conducted to define the performance domain for newly certified audiologists was designed to be consistent with 
the Standards for Educational and Psychological Testing (American Educational Research Association et al., 

1985) and current professional practice. 

Overview of the Job Analysis Methodology 

The job analysis described in this study involved a multi-method approach that included a panel of 
subject-matter experts and a large-scale survey of practicing audiologists as well as educators of and supervisors 
of audiologists. The panel consisted of 14 experienced and accomplished audiologists working in a variety of 
settings (e.g., university, private practice, hospital). These experts also had representation by gender, 
race/ethnicity, and geographic region. The primary responsibility of the expert panel was to define the 
performance domain of a newly certified audiologist. This domain (defined by the panel to consist of task 
statements and knowledge areas) served as the content of the job analysis survey. This survey was then 



Greenberg, S., & Smith, I. L. (1987). Evaluation of the Requirements for the Certificates of Clinical 
Competence of the American Speech-Language-Hearing Association . New York: Professional Examination 
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administered, by mail, to 3,612 practicing audiologists, 260 educators (academic and clinical directors of 
audiology programs), and 420 clinical-fellowship supervisors These survey recipients were asked to make 
three judgments: First, they were asked to rate the importance of the clinical activity statements and knowledge 
areas for newly certified audiologists. Next, they were asked to identify where the clinical activities and 
knowledge areas are learned by newly certified audiologists. Finally, they were asked to identify where the 
clinical activities and knowledge areas should be learned by newly certified audiologists. The Judgments of those 
responding to the survey were then analyzed to identify core clinical activities and knowledge areas. That is, 
clinical activities and knowledge areas that all groups (practicing audiologists, educators, and supervisors) and 
subgroups of practicing audiologists (defined by practice setting, years certified, educational degree, sex, gender, 
and geographic region) rated to be important. Judgments were also analyzed to determine if, and where, there 
were discrepancies between indications of where the clinical activities and knowledge areas were learned and 
where they should be learned. 



METHODS 



Build a Draft Performance Domain 



Typically, the first step in a job analysis is to construct a draft performance domain. This draft serves 
as a starting point, a "straw person," for a panel of subject-matter experts to review critically and revise. 
Experience indicates that it is much easier and more productive for panel members to react to an existing draft 
performance domain than for them to create a performance domain. The performance domain defined in the 
1987 job analysis study served as the draft domain for the current job analysis study. That domain consisted of 
three job dimensions (Evaluation, Treatment, and Administration) each defined by task statements, knowledge 
statements, and skill statements. 

Assemble a Panel of Subject-Matter Experts 

ASHA was asked to select approximately 12 members to serve on the expert panel. The criteria for 
selection were: (1) members were to be recognized experts in audiology, (2) members were to come from a 
range of practice settings, (3) members needed to be able to work cooperatively with other experts towards 
coming to consensus on a definition of a performance domain for newly certified audiologists, and (4) members 
were to be diverse with respect to gender, race/ethnicity, and geographic region. ASHA selected 14 individuals 
to serve on the expert panel (see Appendix A). The median year in which panel members received their 
Certificates of Clinical Competence was 1976. Eight of the members were female and 12 were White (non- 
Hispanic); 10 members were from the Central region of the country, two were from the Northeast region, and 
one each was from the West and Southern regions of the country. 

Conduct a Meeting of the Subiect-Matter-Expert Panel 

The panel of subject-matter experts met with ETS Research staff on December 9, 10 and 11; the 
meeting was held at ASHA’s national office, in Rockville, Maryland. The purpose of this meeting was to 
critically review the draft performance domain, and to come to consensus on any modifications believed by the 
panel to be necessary. That is, panel members were asked to revise the domain (to add, delete, or reorganize 
content, and to make wording changes) so that it accurately reflected their consensus of the content important for 
newly certified audiologists. 
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Eighty percent of the educators had a doctorate in audiology. Also, although three groups were identified based 
on their main area of practice, we recognize that clinical-fellowship supervisors are practicing audiologists. 



3 



Prior to the meeting . Prior to this meeting, each panel member was asked to review one of the three 
job dimensions (either Evaluation, Treatment, or Administration) from the draft performance domain. They were 
asked to review and modify any of the task statements, knowledge statements, and skill statements that defined 
the one job dimension. This pre-meeting assignment was done to facilitate the revision process during the actual 
panel meeting. Only one job dimension was assigned to each member to reduce each member’s workload. All 
three job dimensions were reviewed by multiple panel members. The panel members were asked to bring their 
comments and recommendations for revision to the December meeting. 

During the meeting . Considerable discussion took place during the December meeting. From the 
outset, it was clear that the draft performance domain was not adequate. Panel members did not believe that it 
reflected current professional practice, nor did they believe that the domain was defined in sufficient detail. One 
of the primary issues that arose was the confusion beUveen task statements and skill statements. Panel members 
had a very difficult time trying to differentiate between tasks and skills, as represented in the draft performance 
domain. For example, the skill "Select and adapt test, materials, and procedures to meet the unique 
characteristics of the client" was believed to be too similar to the task "Select valid and reliable evaluation 
procedures, instruments, and materials to match the unique characteristics of the client." Similarly, skill 
statements such as, "Read professional literature applicable to the treatment program, "Gather and maintain up-to- 
date information about instrumentation and materials for treatment," and "Document the treatment program" were 
believed by the panel to be tasks and not skills. After much thoughtful deliberation, the panel members, in 
agreement with the ETS Research representatives, decided to forgo the inclusion of separate sections of skill 
statements. Instead, the members decided to "fold" relevant skill statements into the appropriate task-statement 
sections of the domain. That is, skill statements believed to be important were included among the task 
statements for each job dimension. The panel members agreed that the performance domain for a newly certified 
audiologist could be appropriately and comprehensively defined by job dimensions that were defined by both task 
statements and knowledge areas. 

In addition to consolidating the skill statements and task statements, the panel members restructured the 
dimensionality of the performance domain. As noted previously, the performance domain defined in 1987 was 
represented by the job dimensions Evaluation, Treatment, and Administration; each dimension being defined by 
task statements, knowledge statements, and skill statements. This structure was modified by the panel members. 
The two dimensions. Evaluation and Treatment were retained, but the dimension Administration was replaced by 
two dimensions. Related Professional Activities and Other Professional Activities. These latter two dimensions 
dealt with supervisory and legislative professional responsibilities, as well as administrative responsibilities. The 
structure of the knowledge areas was also modified. Knowledge statements that were originally clustered under 
the dimension Evaluation and the dimension Treatment, were consolidated and subsumed under the new 
knowledge dimension, Basic BCnowledge for Evaluation and Treatment. A new dimension. Stimulus Factors, was 
added; this dimension dealt with knowledge of acoustic and non-acoustic factors. The dimension. Methods, was 
also added; this dimension dealt primarily with knowledge associated with relevant "preferred practice patterns," 
as defined in Preferred Practice Patterns for the Professions of Speech-Language Pathology and Audiology 
(ASHA, 1993). Finally, the dimension. Knowledge for Related Professional Activities, was added; this 
dimension dealt with knowledge in support of supervisory, legislative, and administrative responsibilities. The 
last series of modifications to the performance domain were directed towards the individual task statements and 
knowledge statements that defined the job dimensions. A large proportion of the statements (task and 
knowledge) from the 1987 domain were reworded to reflect more accurately the current state of professional 
practice in audiology. Additionally, many statements were judged to be irrelevant and/or vague; these were 
deleted and replaced with more appropriate statements. 

After the meeting . The revised performance domain was edited and "cleaned up" (e.g., the format was 
revised, correct terminology and spelling were verified) by the ETS Research team. This revised domain was 
then mailed to four members of the subject-matter-expert panel. These four members were asked to review the 
revised domain for accuracy and to suggest any further modifications. Their recommendations (primarily 
wording changes to task statements and knowledge areas) were incorporated into the domain and then shared 
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with the remaining members of the panel. These members were, likewise, asked to review the second revision of 
the performance domain. The recommendations of these members (again, primarily minor wording changes) 
were also incorporated into the performance domain. This two-phased post-meeting review process was used to 
facilitate the overall revision of the domain. (That is, it is much more productive to interpret and integrate a few 
members’ comments first and then to ask the other members to comment on the newly revised version, than it is 
to interpret and integrate the comments of all 15 members at the same time.) 

The final version of the performance domain was then placed into a survey format by ETS Research 
staff A cover letter (encouraging participation in the survey) and an introduction (briefly describing the survey 
content and how it was developed) were added. Instructions and three rating scales (Importance, Where Learned, 
and Where Should Be Learned- allons regarding test construction and curriculum redesign.were also added, as 
was a section asking for biographical information from eventual survey respondents. This job analysis survey 
was then shared with both the panel members and the ASHA project staff The members and project staff were 
asked to review the job analysis survey and to offer any recommendations for revision. Panel members 
commented primarily on the descriptors that served to anchor the points on the ratings scales. The ASHA 
project staff commented, appropriately, on all components of the job analysis survey (cover letter, introduction, 
rating scales, and biographical information). The recommendations from both the panel members and the ASHA 
project staff were used to revise the job analysis survey. Most revisions dealt with minor wording changes to 
clarify meaning. One salient modification, however, was the changing (in title only) from task statements to 
clinical activity statements. ASHA project staff believed that clinical activities, and not tasks, better represented 
the performance domain for a newly certified audiologist. This change in title was made and shared with the 
panel members. The revised job analysis survey, approved by the ASHA project staff, was then pilot tested on a 
sample of experts in the field of audiology. The pilot test is described next. 

Conduct a Pilot Test of the Job Analysis Survey 

The job analysis survey was mailed to a total of 34 experts in the field of audiology. These experts 
were selected by ASHA and represented a range of practice settings (e.g., hospitals, universities, private offices, 
clinics). These 34 participants represented 18 randomly selected practitioners and educators/supervisors, persons 
similar to those who would be participating in the actual, large-scale survey administration, and 16 professionals 
from important constituencies within the field of audiology (see Appendix B for a list of the constituencies 
represented. The purpose of the pilot test was to determine if the job analysis survey (including the cover letter 
and instructions) was clearly viritten and easy to complete. In addition, the pilot test provided the job experts 
with the opportunity to comment on the clinical activity statements and knowledge areas. It also provided an 
indication of the time it took participants to complete the survey. The 34 experts were asked to indicate their 
suggestions for revising the survey on a septirate Pilot Test Questionnaire (see Appendix C) that was developed 
by ETS Research staff. 

In total, 18 of the 34 participants (53%) responded to the pilot test; this total represented 9 respondents 
from each of the two groups. The responses to the Pilot Test Questionnaire indicated that the cover letter and 
the instructions were clear and easy to understand. Similarly, they reported that the biographical information was 
appropriate and easy to complete. While there were suggestions to change the wording of some clinical activity 
statements and knowledge areas, there was no consistency in the particular statements or areas that were 
mentioned or in the wording that was suggested. Since the wording had been carefully reviewed several times 
by the panel of subject-matter experts, no changes were made to the wording of the statements or areas. 
Respondents also commented that the rating scales had not printed out clearly on some of the pages of the 
survey; this was corrected. 

On average, it took the respondents 50 minutes to complete the job analysis survey; this is consistent 
with our initial estimate of 45 minutes to complete the survey. Even so, some respondents believed that the 
survey took too long to complete in one sitting, and suggested that we change the cover letter to emphasize the 
criticality of each person responding to the survey. This suggestion was included in a revision to the cover 
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letter. We also added a statement to the cover letter indicating that the participants may prefer to complete the 
survey in more than one sitting, for example, to complete the clinical activities in one sitting and the knowledge 
areas at another time. 

Description of the Job Analysis Survey 

The job analysis survey consisted of both clinical activity statements and knowledge areas. The clinical 
activity' statements (N = 58) were clustered within four major job dimensions: Evaluation (n = 18), Treatment 
(n = 19), Related Professional Activities (n = 19), and Other Professional Activities (n = 2). The knowledge 
areas (N = 118; the 118 includes 61 domains and 57 subdomains) were clustered within five major sections: 

Basic Knowledge for Evaluation and Treatment (n = 17), Stimulus Factors (n = 6), Methods (n = 24 domains 
and 54 subdomains). Test Analysis (n = 1 domain and 3 subdomains), and Knowledge for Related Professional 
Activities (n = 13). The job analysis survey also included a section that asked respondents to indicate how well 
the clinical activity statements and knowledge areas covered what a newly certified audiologist should be able to 
do and know. The last section of the survey asked the respondents to provide background information 
(e.g., gender, race/ethnicity, year received certificate of clinical competence). 

As will be described below, the job analysis survey was administered to three different groups of 
professionals in the field of audiology: practitioners, educators (academic directors and clinical directors of 
audiology programs), and clinical-fellowship supervisors. To accommodate the different perspectives that these 
groups of professionals may have in relation to the practice of audiology, two versions of the job analysis survey 
were constructed (see Appendix D). One version was administered to practitioners. The second version was 
administered to the educators and supervisors. The clinical activity statements and knowledge areas were 
identical in the two versions of the survey, as were the other two sections of the survey (content coverage and 
background information). The difference between the two versions was in the wording of two of the three rating 
scales that the respondents were asked to use as they judged each clinical activity statement (N = 58) and each 
knowledge area (N = 118). 

Each clinical activity statement and knowledge area was judged on three rating scales: Importance, 
Where Learned, and Where Should Be Learned. The wording of the Importance scale was the same in the two 
versions of the survey. However, the wording of the latter two scales was different in the two versions. In the 
practitioner survey, the focus was on the practitioner himself or herself. In the educator/supervisor survey, the 
focus was on newly certified audiologists, in general. The three sets of rating-scale stems for clinical activity 
statements and knowledge areas are presented in Tables 1 and 2, respectively. The scale anchors (definitions of 
the scale points) for the three sets of rating scales were the same for the clinical activity statements and the 
knowledge areas. They were also the same across the two versions of the survey. The scale anchors are 
presented in Table 3. 



TABLE 1 

RATING SCALES: CLINICAL ACTIVITY STATEMENTS 

Practitioners Educators/Supervisors 

Importance How important is the correct performance of this How important is the correct performance of this 

clinical activity for a newlv certified audiologist to be clinical activity for a newly certified audiologist to be 
considered competent for independent practice? considered competent for independent practice? 



Where Learned 



Where did you, as a newlv certified audiologist, learn Where does a newlv certified audiologist learn to 
to perform this activity? perform this activit>'? 



Where Should Be 
Learned 



Where would you, as a newlv certified audiologist. Where should a newlv certified audiologist learn to 
have preferred to learn to perform this activity? perform this activit> ? 




BEST 



COPY 




TABLE 2 

RATING SCALES: KNOWLEDGE AREAS 
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Practitioners 


Educators/Supervisors 


Importance 


How imoortant is this knowledge area for a newlv 
certified audiologist to be considered competent for 
independent practice? 


How important is this knowledge area for a newlv 
certified audiologist to be considered competent for 
independent practice? 


Where Learned 


Where did vou, as a newlv cenified audiologist, 
acquire this knowledge area? 


Where does a newlv certified audiologist acquire this 
knowledge area? 


Where Should Be 
Learned 


Where would vou, as a newlv certified audiologist, 
have preferred to have acquired this knowledge area? 


Where should a newlv certified audiologist acquire this 
knowledge area? 



TABLE 3 

R.ATING SCALE ANCHORS 

Importance 0 = Not performed or not needed 

1 = Not important 

2 = Marginally important 

3 = Moderately important 

4 = Important 

5 = Very important 

Where Learned 1 = School - Classroom 

2 = School - Practicum 

3 = Clinical fellowship 

4 = On the job, after certification 

5 = Continuing education, after certification 

Where Should Be Learned 1 = School - Classroom 

2 = School - Practicum 

3 = Clinical fellowship 

4 = On the job, after certification 

5 = Continuing education, after certification 



Administer the Job Analysis Surveys 

Select survey samples . Three groups of professionals in the field of audiology were surveyed: 

(1) practitioners— individuals who had received their certificate of clinical competence and who were in current 
practice; (2) educators— directors of academic programs in audiology and directors of clinical programs in 
audiology; and (3) clinical-fellowship supervisors— individuals responsible for supervising audiologists during the 
clinical-fellowship experience. These three groups of professionals were believed to represent the most relevant 
and knowledgeable constituencies involved in the education and training of audiologists. 

The practitioners (N = 3,612) were randomly selected by ASHA from its membership database. Though 
selected randomly, certain guidelines were established to frame the selection process. That is, in total, the 
sample selected was to: (1) only include certified audiologists, (2) over represent audiologists who received their 
Certificate of Clinical Competence within the past five years (to ensure representation in the survey of newly 
certified audiologists), and (3) cover a range of practice settings (e.g., hospital, school, physician’s office, own 
office). The sample was also to have representation by gender, race/ethnicity, and geographic region. 

The educators (N = 260; 130 academic program directors and 130 clinical program directors) were also 
selected from the database maintained by ASHA. These educators represent the population of academic and 
clinical program directors from educational institutions granting degrees in audiology. The clinical-fellowship 




supervisors (N = 420), similar to the educators, were selected from the ASHA database and represent the 
population of current clinical-fellowship supervisors. 
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Mail surveys . ASHA project staff provided ETS Research staff with two sets of pre-addressed mailing 
labels for all three groups. The first set was used to mail the surveys to the professionals in each of the three 
groups; the mailing occurred in March of 1995. The second set of labels was used to mail a follow-up post 
card; this post card was mailed approximately one week after the surveys were mailed, and reminded the 
recipients to complete and return their surveys. With the exception of the clinical program directors, surveys 
were mailed directly to the intended professionals. In the case of the educators, two copies of the survey were 
mailed directly to each academic program director. This person was asked to complete one survey and to give 
the second copy to the audiology program director to complete. This procedure was followed because a list of 
audiology program directors was not readily available. 

In addition to the follow-up post cards, each academic program director was contacted by telephone. 

The academic directors were asked if they had received the two copies of the survey and if they had returned 
their completed survey. They were also asked if they were able to forward the second copy to the person 
responsible for directing the audiology program and if they would remind that person to complete and return the 
survey. 

Data Analyses 

Levels of analysis . Analyses were conducted at multiple levels of aggregation. First analyses were 
conducted for each of the three groups of survey respondents: practitioners, educators, and clinical-fellowship 
supervisors. These group-level analyses were followed by a series of subgroup analyses. That is, the 
practitioners were partitioned into subgroups as defined by their responses to the background information The 
following six subgroups were created: gender, race/ethnicity, geographic region, years certified, practice setting, 
and educational level. Both levels of analyses are critical to ensure the relevance and fairness of the decisions 
that will be made based upon the outcomes of this Job analysis study. 

Verification of responses . The working definition of a practitioner, for this study, was a certified, 
practicing audiologist (i.e., part-time or full-time clinical service provider) with either a master’s degree or a 
doctorate in audiology. Only practitioners who meet the study’s criteria were included in subsequent data 
analyses. The working definition of an educator was someone who identified himself/herself as either (1) a 
college or university educator or (2) as a chairperson, department head, or director. And the working definition 
of a clinical-fellowship supervisor was someone who identified himself/herself as either (1) a clinical service 
provider, (2) an administrator or manager, or (3) a supervisor of clinical activity. Similar to the practitioners, 
only those educators and clinical-fellowship supervisors who met the study’s criteria were included in subsequent 
data analyses. 

Frequency counts of zero responses . As noted above, each clinical activity statement and each 
knowledge area was rated on a 6-point importance scale. The zero point on this scale indicated that the 
statement or area was either not performed by or not needed by a newly certified audiologist. For each 
statement and area, the percent of zero responses was computed separately for practitioners, educators, and 
clinical-fellowship supervisors. If 51% or more of the respondents from any of the three groups provided a zero 
response, the clinical activity statement and/or knowledge area was flagged (cf. Rosenfeld, Freeberg, & Bukatko, 
1992). Any flagged statements or areas would signify, therefore, that less than a majority of the respondents 
from any group believed them to be relevant parts of the performance domain of newly certified audiologists. 
Clearly, if the Job-relatedness of clinical activity statements and knowledge areas is to be supported, a majority 



A minimum of 50 practitioners was needed in a subgroup for that subgroup to be included in any formal 
analyses. This minimum was established to ensure the stability and accuracy of the outcomes. 
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of respondents should indicate that the statements and areas are a legitimate part of the performance domain of 
newly certified audiologists. 
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Mean importance ratings . The mean importance rating for each clinical activity statement and each 
knowledge area was computed. Means were computed separately for practitioners, educators, and clinical- 
fellowship supervisors; they were also computed for relevant subgroups of practitioners. The mean provides an 
indication of the absolute level of importance attributed to the statements and areas. It is used to differentiate 
between more important and less important clinical activity statements and more important and less important 
knowledge areas. A mean of 3.50 (the midpoint between the two scale points signifying moderately important 
and important) was established as the criterion for classifying more important and less important statements and 
areas. That is, clinical activity statements that meet or exceed the 3.50 mean importance criterion for all three 
groups and M relevant subgroups of practitioners were classified as more important; any statement not meeting 
or exceeding the 3.50 criterion for all groups and all subgroups was classified as less important and flagged for 
review by the Standards Council. (The same standards were applied to each of the knowledge areas.) As noted 
by Tannenbaum and Rosen feld (1994), this 3.50 criterion is consistent with a content validation strategy that 
appropriately reduces the probability of defining performance domains by job content that is judged to be of 
minimal importance by large numbers of practicing professionals. 

Content coverage ratings . Respondents were asked to rate how well the clinical activity statements 
covered what a newly certified audiologist should be able to do and how well the knowledge areas covered what 
a newly certified audiologist should know. These judgments provide an indication of the comprehensiveness of 
the performance domain defined in the job analysis survey. The rating scale anchors for these judgments ranged 
from (1) very poorly to (5) very well; the midpoint was (3) adequately. The judgments were computed 
separately for practitioners, educators, and clinical- fellowship supervisors. 

Discrepancy scores . Two related issues of particular interest to ASHA are standards modification and 
curriculum redesign. That is, ASHA would like the outcomes from this job analysis study to assist in any future 
decisions that the Standards Council may make with respect to recommending changes to current certification 
standards and current audiology curriculum. One source of information (though not the only source) that may be 
useful is to determine if practitioners, educators, and clinical-fellowship supervisors perceive that newly certified 
audiologists are learning to perform clinical activities and acquiring relevant knowledge at the perceived 
appropriate points in their education. In other words, are newly certified audiologists learning to perform clinical 
activities where they should be learning to perform them? And are they acquiring relevant knowledge where 
they should be acquiring this knowledge? 

To address these questions discrepancy scores were computed: for each clinical activity statement and 
each knowledge area, frequency counts (reported as percentages) were computed for each of the response 
categories for the Where Learned and Where Should Be Learned rating scales; then the Where Should Be 
Learned responses were subtracted from the Where Learned responses, i.e.. Where Learned minus Where Should 
Be Learned These differences were the discrepancy scores. Discrepancy scores were computed separately for 
practitioners, educators, and clinical-fellowship supervisors, as well as for practitioners who have been certified 
for five years or less and practitioners who have been certified for more than five years. For each statement and 
area, seven discrepancy scores were possible: -3, -2, -1, 0, +1, +2, and +3. Each of these values has a unique 
meaning (see Table 4). Nonetheless, a negative discrepancy score indicates that the clinical activity (knowledge 
area) should be learned (acquired) later in the educational process. A zero (0) discrepancy score indicates that 
the clinical activity (knowledge area) is being learned (acquired) where it should be learned (acquired). And a 



Discrepancy scores were computed on recoded values for the Where Learned and Where Should Be Learned 
rating scales. That is, on both scales, values 1 and 2 were recoded to equal a value of 1; and values 4 and 5 
were recoded to equal a value of 4. A value of 3 was not recoded. This recoding enabled uniquely defined 
discrepancy scores to be computed. 
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positive discrepancy score indicates that the clinical activity (knowledge area) should be learned (acquired) earlier 
in the educational process. Clinical activity statements and knowledge areas were flagged if the zero (0) 
discrepancy score accounted for less than 75% of the responses. In other words, if more than 25% of the 
responses indicated that a clinical activity or knowledge area was not being learned (acquired) where it should be 
(any non-zero value), it was flagged. The 25% criterion was used because it signifies that a meaningful number 
of respondents (in the case of practitioners, approximately 300) do not believe that newly certified audiologists 
are learning to perform clinical activities or acquiring professional knowledge at the appropriate points in their 
professional education. And while other, less stringent, criteria could certainly be applied, we believe that given 
the high-stakes decisions that the information generated from this study will support, the conservative standard 
we have used is both reasonable and appropriate. 



T.\BLE 4 

DISCREPANCY SCORES FOR CLINICAL ACTIVITY STATEMENTS AND KNOWLEDGE AREAS 
Value Meaning 

>3 Although learned (acquired) in school, should be learned (acquired) after certification 

•2 Although learned (acquired) in school, should be learned (acquired) during the clinical fellowship 

•1 Although learned (acquired) during the clinical fellowship, should be learned (acquired) after certification 

0 Is being learned (acquired) where it should be learned (acquired) 

+1 Although learned (acquired) after certification, should be learned (acquired) during the clinical fellowship 

+2 Although learned (acquired) during the clinical fellowship, should be learned (acquired) in school 

+3 Although learned (acquired) after certification, should be learned (acquired) in school 



RESULTS 



Response Rates 

Surveys were mailed to 3,612 practicing audiologists, 260 educators (academic and clinical directors of 
audiology programs), and 420 clinical-fellowship supervisors. Surveys were returned by 1,331 practitioners 
(37% response rate), 83 educators (32% response rate), and 126 clinical-fellowship supervisors (30% response 
rate). These response rates are consistent with mail surveys of this type and are sufficient for the analysis to be 
conducted in this study (cf. Rosenfeld & Tannenbaum, 1991; Reynolds & Rosenfeld, 1992; Tannenbaum, 1994). 

Respondent Demographics 

The demographic distributions of the three groups of respondents (practitioners, educators, and clinical- 
fellowship supervisors) are presented in Table 5. (The percentages have been rounded to the nearest whole 
number and, therefore, may not equal 100). A sununary of the demographic characteristics for each group of 
respondents is presented in the text below. 

Practitioners . First, of the 1,331 respondents, 1,192 (90%) met the working definition of a practitioner. 
That is, 1,192 were certified, practicing audiologists with either a master’s degree or a doctorate in audiology. 
The majority of respondents were female (85%) and White (95%). Many practitioners (40%) had been 
practicing as a certified audiologist for six or less years; though nearly as many (37%) had been practicing for 10 
or more years. Most practitioners were employed full time (79%), had received their certificate of clinical 
competence (CCC) more than five years ago (71%), and held a master’s degree in audiology (96%). 

Practitioners reported working in schools (7%), hospitals (27%), private physician’s office (27%), SLP’s or 
AUD’s office (7%), or their own office (9%). Finally, the practitioners were geographically representative: 
Northeast (30%), Central (28%), South (23%), and Far West (17%). 
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Educators . Approximately half of the respondents (51%) were female, and nearly all of the respondents 
(94%) were White. Most educators (64%) had been practicing as a certified audiologist for 16 or more years; 
few (11%) had been practicing for six or less years. Almost all of the educators (95%) had received their CCC 
more than five years ago. The majority of educators (80%) had a doctorate in audiology. As expected, the 
majority (90%) worked in a college or university setting. Finally, the educators were geographically 
representative: Northeast (29%), Central (27%), South (29%), and Far West (14%). 

TABLE 5 

DEMOGRAPHIC CHARACTERISTICS OF RESPONDENTS 



Practitioners Educators Clinical-Fellowship 

Supervisors 





N 


% 


N 


% 


N 


% 


Gender 














Female 


1,009 


85 


42 


51 


80 


63 


Male 


180 


15 


40 


48 


46 


37 


No Response 






1 


1 






Race/Ethnicity 














White (non-Hispanic) 


1,126 


95 


78 


94 


118 


94 


African American 


17 


1 






2 


2 


Hispanic 


11 


1 


1 


1 


1 


1 


Asian American 


24 


2 


1 


1 


1 


1 


No Response 


9 


1 


3 


4 


2 


2 


Years in Certified Practice 














^6 


481 


40 


9 


11 


26 


21 


7-9 


268 


23 


8 


10 


10 


8 


10-12 


198 


17 


4 


5 


11 


9 


13-15 


77 


7 


7 


8 


26 


21 


^ 16 


167 


14 


53 


63 


53 


42 


No Response 






2 


2 






Years Since Received CCC 














<5 


341 


29 


4 


5 


19 


15 


> 5 


847 


71 


79 


95 


107 


85 


Highest Educational Level 














Master’s 


1,148 


96 


17 


20 


108 


86 


Doctorate 


44 


4 


66 


80 


18 


. 14 


Work Setting 














School 


79 


7 






9 


7 


College/University 


30 


3 


75 


90 


16 


13 


Hospital 


319 


27 


5 


6 


28 


22 


Private Physician’s Office 


324 


27 


2 


2 


28 


22 


SLP’s or AUD’s Office 


84 


7 






7 


6 


Own Office 


109 


9 






23 


18 


Residential Healthcare Facility 


31 


3 






1 


1 


Other/Multiple Responses 


216 


18 


1 


1 


14 


11 


Geographic Region 














Northeast 


361 


30 


24 


29 


39 


31 


Central 


338 


28 


22 


27 


34 


27 


Southern 


272 


23 


24 


29 


36 


29 


Far West 


206 


17 


12 


14 


16 


13 


No Response 


15 


1 


1 


1 
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ClinicaUfeilowship supervisors . Most of the respondents (63%) were female, and nearly all of the 
respondents (94%) were White. Although a large proportion of clinical-fellowship supervisors (42%) had been 
practicing as a certified audiologist for 16 or more years, many (21%) had been doing so for six or less years. 
Similarly, a large proportion (85%) had received their CCC more than five years ago. The majority (86%) held 
a master’s degree in audiology. The majority of clinical-fellowship supervisors (75%) reported working in the 
following settings: hospital (22%), private physician’s office (22%), own office (18%), and college/university 
(13%). The clinical-fellowship supervisors were also geographically representative: Northeast (31%), Central 
(27%), South (29%), and Far West (13%). 

Frequency Counts of Zero Responses 

The percentage of zero responses for each clinical activity statement and each knowledge area are 
presented in Appendix E. Statements and areas were flagged, if 51% or more of the respondents from any of the 
three groups (practitioners, educators, clinical-fellowship supervisors) provided a zero response. Only one 
clinical activity statement was flagged, #1 1 — "Evaluate and document changes in the functional status of neural 
tissue or structures during operative procedures." This statement was flagged by 61% of the practitioners. No 
knowledge areas were flagged. These results indicate that the panel of subject-matter experts had successfully 
defined a performance domain that was relevant to the job of a newly certified audiologist. 

Mean Importance Ratings: Clinical Activity Statements 

Practitioners, educators, and clinical-fellowship supervisors . Mean importance ratings were computed 
for clinical activity statements separately for the three groups of respondents. The mean ratings are presented in 
Appendix F. Any statement with a mean rating of less than 3.50, for any of the respondent groups, was flagged 
(i.e., highlighted in gray in the Appendix). In total, 12 of the 58 clinical activity statements (21%) were flagged 
by one or more of the respondent groups (see Table 6, shaded means). The practitioners had flagged 1 1 
statements, and the educators and clinical-fellowship supervisors had flagged nine statements each. Of the 12 
that failed the 3.50 cut-point, four were within the Evaluation dimension and seven were among the cluster of 
statements within the Related Professional Activities dimension that dealt specifically with administrative 
responsibilities. All of the clinical activity statements within the Treatment dimension passed the 3.50 cut-point. 
We recommend that the 12 clinical activity statements that failed the 3.50 cut-point be excluded from the test 
specifications that define the content domain for a certification examination in audiology. (Flagged statements 
should only be considered for inclusion if compelling, written justifications can be supplied.) 



TABLE 6 



CLINICAL ACTIVITY STATEMENTS THAT FAILED THE 3.50 CUT-POINT 






Practitioners Educators 


Clinical-Fellowship 

Supervisors 


Evaluation 






#3 


"Screen speech-language and other factors affecting communication function to 
facilitate referrals" 


III 3j;6 


ill 


U7 


"Remove cerumen by a variety of techniques and equipment" 




iii 


U9 


"Calibrate equipment to accepted standards" 


ini 3.74 


3.50 


#11 


"Evaluate and document changes in the functional status of neural tissue or 
structures during operative procedures" 


iii m 


n 




Related Professional Activities 






#38 


"Establish supervisory procedures that ensure quality patient/consumer care in 
evaluation and treatment" 


343 3.63 


3.60 


CO 


"Identify unmet programmatic needs, create new programs, or develop links with 
existing programs" 


in 





O 
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TABLE 6 (Cont’d) 



#49 "Plan and implement in-service and public information programs . . . concerning 
the prevention, identification, evaluation, and treatment of communicative 



disorders" 


3.53 


in 


3.53 


#50 "Seek current information regarding the procurement of private, governmental, 
and third-party financial support" 


ill 


3.77 


III 


#5 1 "Oversee those activities necessary for the efficient administration of the 


III 


III 




program" 






#54 "Promote cultural diversiw in recruitment and retention of staff’ 


m 


ill 


2.85 


#55 "identify multi-cultural and underserved populations and promote access to care" 
Other Professional Activities 


III 


ill 




#57 "Conduct and/or participate in research" 


ii 




lii 



The percent of agreement in the groups’ classifications (i.e., the number of statements in common that 
passed the 3.50 cut-point and the number of statements in common that failed the 3.50 cut-point) was computed. 
The percent agreement for educators and clinical-fellowship supervisors was 97% (48 passed for both and 8 
failed for both); the percent agreement for educators and practitioners was 93% (46 passed and 8 failed); and the 
percent agreement for clinical-fellowship supervisors and practitioners was 97% (47 passed and 9 failed). These 
results indicate a high level of agreement between the paired groups of respondents in terms of their 
classifications of more important and less important clinical activity statements. 

Subgroups of practitioners . In addition to the main groups of respondents, we conducted mean analyses 
for relevant subgroups of practitioners. Subgroup analyses are critical because they often uncover less important 
content that was masked by the main-group analysis. That is, a clinical activity statement, for example, that 
passed the 3.50 cut-point for the total group of practitioners may very well be flagged by one or more subgroups 
of practitioners (e.g., females, non- Whites, practitioners working in hospital settings). Subgroup analyses provide 
a safeguard for the sole reliance on main-group analyses. The following subgroups of practitioners were formed: 

• Gender (female, male) 

• Race/Ethnicity (White, non-White) 

• Practice Setting (school, hospital, private physician’s office, SLP’s or AUD’s office, own office) 

• Years Certified (< 5, > 5) 

• Highest Educational Level (Master’s, Doctorate) ^ 

• Geographic Region (Northeast, Central, Southern, Far West) 

The mean importance ratings across all the subgroups were compared to the 3.50 cut-point. Any clinical activity 
statement with a mean rating of less than 3.50, for any of the subgroups, was flagged (i.e., highlighted in gray in 
Appendix G). Of the 58 clinical activity statements, 18 (31%) were flagged by one or more of the subgroups of 
practitioners. However, 12 of these 18 had already been flagged by the main-group analyses. Therefore, the 
subgroup analysis identified six additional statements that had gone "undetected" by the main-group analyses. 
These six statements are: 



• #27 — "Calibrate equipment to accepted standards" 

• #40 — "Provide supervisees . . . with appropriate practical experiences to develop professional expertise” 

• #42 — "Provide instruction in ethical, legal, and regulatory aspects of the profession" 

• #45 — "Promote legislation and regulation that will ensure an acceptable quality and availability of services 



Although only 44 practitioners held a Doctoral degree, this subgroup was included because of the relevance 
and importance of their judgments to informing potential future decisions regarding test construction and 
curriculum redesign. 
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while monitoring and opposing legislation harmful to the communicatively handicapped" 

• #46 - "Promote legislation beneficial to the profession" 

• #47 — "Advocate for direct third-paru* payment to credentialed audiologists" 

The percent of agreement within each of the subgroups’ classifications was also computed. These 
percentages are presented in Table 7. As illustrated, the lowest percent of agreement (84%) was between 
practitioners working in their own office and practitioners working in either a hospital or a private physician’s 
office. The highest percent of agreement (100%) was between practitioners in the Northeast and Southern 
regions of the country. The median value was 93%, indicating that, overall, there was a high level of within 
subgroup agreement. 

Content Coverage: Clinical Activity Statements 

All three groups of respondents were asked to judge how well the clinical activity statements, in total, 
covered what a newly certified audiologist should be able to do. Judgments were made on a 5-point scale. The 
scale points were: (1) very poorly, (2) poorly, (3) adequately, (4) well, and (5) very well. The results for the 
three groups are presented in Table 8. Nearly 100% of the respondents in each of the three groups judged the 
performance domain to be at least adequately covered. Close to 75% of the respondents in each group judged 
the domain to be either well covered or very well covered. 



TABLE 7 

PERCENT OF AGREEMENT WITHIN SUBGROUPS: CLINICAL ACTIVITY STATEMENTS 

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 

_ . I I I I I 

, I I I I I 

^ ^ I I I I I 

2 Male 93 J i i i i 

Race/Ethnicity 

3 White (non-Hispanic) 

4 Non-White 93 j i i i 

Years Since Received CCC 

^ II I 

6 > 5 95 J I I 

Highest Educational Level 

7 Master’s 

8 Doctorate 93 j i 

Work Setting 

9 School 



10 Hospital 


86 






1 1 Private Physician’s Office 


86 


93 




12 SLP’s or AUD’s Office 


90 


90 


97 


13 Own Office 


84 


84 


91 91 



Geographic Region 

14 Northeast 

1 5 Central 95 



16 Southern 100 95 

17 Far West 98 93 



16 17 



98 



er|c 
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TABLE 8 

CONTENT COVERAGE: CLINICAL ACTIVITY STATEMENTS 



14 



Practitioners 


Educators 


Clinical-Fellowship 

Supervisors 


N % 


N % 


N % 



Very Poorly 


I 


0 


0 


0 


0 


0 


Poorly 


14 


I 


2 


3 


1 


I 


Adequately 


247 


23 


21 


27 


30 


25 


Well 


521 


48 


40 


51 


53 


45 


Very Well 


296 


27 


16 


20 


34 


29 



Mean Importance Ratings: Knowledge Areas 

Practitioners, educators, and clinical-fellowship supervisors . Mean importance ratings were computed 
for knowledge areas separately for the three groups of respondents. The mean ratings are presented in Appendix 
H. Any area with a mean rating of less than 3.50, for any of the respondent groups, was flagged (i.e., 
highlighted in gray in the Appendix). In total, 28 of the 118 knowledge areas (24%) were flagged by one or 
more of the respondent groups (see Table 9, shaded means). The practitioners had flagged 27 areas, the 
educators had flagged 17 areas, and the clinical-fellowship supervisors had flagged 24 areas. Of the 28 that 
failed the 3.50 cut-point, four were within the Basic Knowledge for Evaluation and Treatment section. All the 
knowledge areas dealing with methods related to Speech-Language Screening (n = 3) and Neurophysiologic 
Intraoperative Monitoring (n = 4) were flagged; similarly, all areas related to Test Analysis (n = 4) were flagged. 
As before, we recommend that the 28 knowledge areas that failed the 3.50 cut-point be excluded from the test 
specifications that define the content domain for a certification examination in audiology. (Flagged knowledge 
areas should only be considered for inclusion if compelling, written justifications can be supplied.) 

Overall, the educators were the most "liberal" in their judgments; that is, more knowledge areas passed 
the 3.50 cut-point for this group than for either practitioners or clinical- fellowship supervisors. One noticeable 
trend was that while neither clinical-fellowship supervisors nor practitioners believed that "Electrical Stimulation 
for Cochlear Implant," "Implant Selection and Rehabilitation," and "Test Analysis (statistical principles, 
including parametric and non-parametric statistics, and clinical decision analysis)" were important, educators 
judged these areas to be important. Nevertheless, the percent of agreement in the groups’ classifications (i.e., the 
number of areas in common that passed the 3.50 cut-point and the number of areas in common that failed the 
3.50 cut-point) was high. The percent agreement for educators and clinical-fellowship supervisors was 89% (91 
passed for both and 14 failed for both); the percent agreement for educators and practitioners was 92% (91 
passed and 17 failed); and the percent agreement for clinical-fellowship supervisors and practitioners was 96% 

(90 passed and 23 failed). 

Subgroups of practitioners . Mean importance ratings for each knowledge area was computed for each of 
the subgroups of practitioners (i.e., gender, race/ethnicity, practice setting, years certified, highest educational 
level, and geographic region). As before, any knowledge area with a mean rating of less than 3.50 was flagged 
(i.e., highlighted in gray in Appendix I). Of the 118 knowledge areas, 38 (32%) were flagged by one or more of 
the subgroups of practitioners. However, 28 of these 38 had already been flagged by the main-group analyses. 
The 10 additional knowledge areas flagged by the subgroup analyses are: 

Knowledge of . . 

• #22 — [Non-Acoustic Stimulus Factors] "how these characteristics are affected by properties of the delivery 

medium or system (e.g., stimulus electrode impedance)" 

• #33a — [Auditory Evoked Potential Assessment] "Ecoch G" 

• #33c - [Auditory Evoked Potential Assessment] "middle" 




15 



• #35a ~ [Balance System Assessment] "ENG” 

• #39c — [Product Dispensing] ’’cochlear implant processors" 

• #41 e — [Hearing Aid Assessment] ’’administration of communication inventories or questionnaires" 

• #43 — Sensory Aids Assessment 

• #52 ~ [Legislative Professional Activities] ’’workers* compensation’’ 

• #56 ~ [Administrative Professional Activities] "third-party reimbursement" 

• #57 — [Administrative Professional Activities] "quality improvement techniques" 

The percent of agreement within each of the subgroups* classifications was also computed. These 
percentages are presented in Table 10. As illustrated, the lowest percent of agreement (84%) was between 
practitioners with a Mater’s degree and practitioners with a Doctorate. The lower level of agreement was due to 
many more knowledge areas (n = 19) failing the 3.50 cut-point for those with a Master’s degree, but passing the 
cut-point for those with a Doctorate. The highest percent of agreement (98%) was between practitioners in the 
Northeast and Far West regions of the country. The median value was 94%, indicating that, overall, there was a 
high level of within subgroup agreement. 



TABLE 9 

KNOWLEDGE AREAS THAT FAILED THE 3.50 CUT-POINT 







Practitioners 


Educators 


Clinical-Fellowship 

Supervisors 




Basic Knowledge for Evaluation and Treatment 








#3 


"phonologic, morphologic, syntactic, and pragmatic aspects of 
human communication in normal and disordered systems” 




3.89 


336 


#15 


"cerumen management" 




331 




#16 


"pharmacology 


3^0 


239 


3^1: 


#17 


"basic electronics" 




326 


3:33 




Stimulus Factors [Non-Acousticj 








#21 


"physical characteristics of non-acoustic stimuli . . . used to 
elicit non-auditory responses . . ." 


^2i 


lii 


m 


#23 


"non-auditory stimulus analysis, including calibration of safe 
limits of stimulation" 


3.52 


3.53 






Methods 








#25 


"Speech-Language Screening" 


337 


3.58 


mi 


#25a 


"formal" 


2SZ 


III 




#25b 


"informal" 




3.68 




#33d 


[Auditory Evoked Potential Assessment] "late" 




iii 


3.62 


#33e 


[Auditory Evoked Potential Assessment] "event-related (P300) 
or auditory-cognitive potential (P300)" 


334 




3.50 


#34 


"Neurophysiologic Intraoperative Monitoring” 


Xil 


XlS 


34a 


#34a 


"auditory" 


326 


336 


325 


#34b 


"non-auditory" 


237 


2M 


rm 


#34c 


"effects of anesthesia and pharmacological agents on 
electrophysiologic events" 


329 


333 


III 


#35b 


[Balance System Assessment] "rotational-chair" 


3.26 


32 1 


lii 


#35c 


[Balance System Assessment] "posturography" 


324 


323 


ill 


#38e 


[Audiologic al Rehabilitation] "balance function rehabilitation" 


331 


3J2 


sS 


#39d 


[Product Dispensing] "tinnitus maskers” 


3.$6 


32? 


3.52 


#39e 


[Product Dispensing] "tactile/sensor\’ devices" 


336 




m 


#45 


"Sensory Aids Fitting/Orientation" 


3.47 


3.71 


3.50 


#46 


"Electrical Stimulation for Cochlear Implant" 


3.24 


3.58 


329 



® "28 

ERIC 

““ best cow available. 
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#47 


"Implant Selection and Rehabilitation" 
Test Analysis 


3,]? 


3.53 


in 


#48 


"Statistical Principles" 


2,88 


3.71 


ii 


#48a 


"parametric" 


2,80 


3.66 


ill 


#48b 


"non-parametric" 


zm 


3.54 


iil 


#48c 


"clinical decision analysis" 

Knowledge for Related Professional Activities 


2.05 


4.00 


ill 


#61 


[Administrative] "human resources management" 


W 


lii 


ill 



Content Coverage: Knowledge Areas 

All three groups of respondents were asked to judge how well the knowledge areas, in total, covered 
what a newly certified audiologist should know. The results for the three groups are presented in Table 11. As 
before, nearly 100% of the respondents in each of the three groups judged the performance domain to be at least 
adequately covered; and more than 75% of the respondents in each group judged the domain to be either well 
covered or very well covered. 



TABLE 10 

PERCENT OF AGREEMENT WITHIN SUBGROUPS: KNOWLEDGE AREAS 



1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 

1 1 



Gender 

1 Female 

2 Male 
Race/Ethnicity 

3 White (non-Hispanic) 

4 Non-White 

Years Since Received CCC 

5 £5 

6 >5 

Highest Educational Level 

7 Master's 

8 Doctorate 
Work Setting 

9 School 



94 



I 

I 



93 j 



95 ^ 



84 



10 Hospital 


91 






1 1 Private Physician's Office 


90 


97 




12 SLP's or AUD's Office 


88 


96 


93 


13 Own Office 


89 


92 


92 91 






Geographic Region 

14 Northeast 

15 Central 

16 Southern 

17 Far West 



97 

95 95 

98 97 97 
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TABLE 11 

CONTENT COVERAGE: KNOWLEDGE AREAS 



17 



Practitioners 


Educators 


Clinical-Fellowship 

Supervisors 


N % 


N % 


N % 



Very Poorly 


1 


0 


0 


0 


0 


0 


Poorly 


11 


1 


1 


1 


2 


2 


Adequately 


213 


20 


17 


22 


24 


20 


Well 


503 


47 


43 


55 


57 


48 


Very Well 


349 


32 


17 


22 


35 


30 



Discrepancy Scores: Clinical Activity Statements 

As reported earlier, recoded judgments of where clinical activities should be learned were subtracted 
from recoded Judgments of where clinical activities were learned. Seven unique outcomes (discrepancy scores) 
were possible: -3, -2 , -1, 0, +1, +2, and +3 (the meaning of these scores is presented in Table 4). In brief, 
however, a negative sign (-) indicates that a clinical activity should be learned later in the educational process 
(i.e., during the clinical fellowship or after certification). A zero (0) indicates that the clinical activity is being 
learned where it should be learned. And a positive sign (+) indicates that the clinical activity should be learned 
earlier in the educational process (i.e., in school or during the clinical fellowship). A clinical activity statement 
was flagged if the zero (0) discrepancy score accounted for less than 75% of the responses. 

Practitioners, educators, clinical-fellowship supervisors . The discrepancy scores for each clinical activity 
statement were computed separately for practitioners, educators, and clinical-fellowship supervisors. These 
values are presented in Appendix J (flagged statements are highlighted in gray). Accompanying the discrepancy 
scores for each group of respondents are the raw (i.e., pre-recoded) percentages of responses across each of the 
five options (anchors) for each of the two rating scales. For example, accompanying the discrepancy scores for 
practitioners, are the percentage of practitioners responding 1, 2, 3, 4, and 5 to the rating scale Where Learned 
and the percentage of practitioners responding I, 2, 3, 4, and 5 to the rating scale Where Should Be Learned. 

In total, 41 of the 58 clinical activity statements (71%) were flagged by one or more of the respondent 
groups (see Appendix J for the flagged (highlighted) statements). The practitioners flagged 32 statements (55%); 
and the clinical-fellowship supervisors flagged 36 statements (62%). In contrast, the educators flagged five 
statements (9%). In other words, while practitioners believed that only 45% of the clinical activities were being 
learned where they should be learned and clinical-fellowship supervisors believed that only 38% of the clinical 
activities were being learned where they should be learned, educators believed that 91% of the clinical activities 
were, in their judgment, being learned where they should be learned. Clearly, there are differences of opinion 
between the educators and the other two groups of respondents. Nonetheless, in all cases, for all three groups, 
the direction or sign of the discrepancy scores was positive (+), indicating that the flagged clinical activity 
statements should be learned earlier in the educational process. And the most prominent trends that emerged 
were: (1) that the job dimension of Treatment accounted for the largest proportion of flagged statements for 
both clinical- fellowship supervisors (50%) and practitioners (47%), and (2) that clinical-fellowship supervisors 
believed that 25 of the 36 statements they flagged (69%), though learned during the clinical fellowship, should 
be learned in school. 

The percent agreement between practitioners’ and clinical-fellowship supervisors’ classifications (i.e., the 
number of clinical activity statements in common passing the 75% cut-point and the number of statements in 
common failing the 75% cut-point) was moderately high, 78%. This level of agreement was due to 14 
statements that passed the cut-point for one group, but failed for the other group. Five statements failed the cut- 
point for practitioners, but passed the cut-point for clinical-fellowship supervisors; and nine statements failed the 
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cut-point for clinical-fellowship supervisors, but passed the cut-point for practitioners. All five clinical activity 
statements that failed the cut-point for practitioners but passed for clinical-fellowship supervisors were within the 
job dimension of Related Professional Activities; and, not surprisingly, four of the five statements dealt with 
either supervisory or administrative activities: 

• #38 - “Establish supervisory procedures that ensure quality patient/consumer care in evaluation and treatment” 

• #46 — “Promote legislation beneficial to the profession" 

• #50 - "Seek current information regarding the procurement of private, governmental, and third-party financial 

support" 

• #51 “ "Oversee those activities necessary for the efficient administration of the program (e.g., materials 

acquisition, budgeting, recruitment, and retention)" 

• #56 — "Develop programs for conservation of hearing and for prevention of hearing impairment/deafness. 

including identification of genetic, prenatal, and postnatal factors, and all exogenous (e.g., noise) factors 

resulting in preventable hearing loss" 

Subgroup analysis . Discrepancy scores were also computed separately for practitioners who have been 
certified for five years or less and practitioners who have been certified for more than five years. This subgroup 
comparison was considered to be the most relevant for purposes of determining if a discrepancy was perceived to 
exist between where clinical activities are learned by newly certified audiologists and where they should be 
learned by newly certified audiologists. The discrepancy scores (along with the raw percentages for the five 
response options for the Where Learned and Where Should Be Learned rating scales) are presented in Appendix 
K. As before, statements that failed the 75% cut-point have been highlighted in gray. 

In total, 36 of the 58 clinical activity statements (62%) were flagged. Twenty-eight statements were 
flagged by practitioners who have been certified for five years or less and by practitioners who have been 
certified for more than five years. One statement was flagged only by practitioners with five or less years of 
certification; seven statements were flagged only by practitioners with more than five years certification. 

However, all but 2 of the 36 statements were previously flagged by the main-group analyses (i.e., practitioners, 
educators, clinical-fellowship supervisors). The two additional statements flagged by this subgroup comparison 
were #48 — "Identify unmet programmatic needs, create new programs, or develop links with existing programs"; 
and #55 ~ "Identify multi-cultural and underserved populations and promote access to care." The former was 
flagged only by those practitioners who have been certified for five years or less, and the latter was flagged only 
by those who have been certified for more than five years. Although there was a high level of within subgroup 
agreement (86%), six statements, in addition to #55, failed the cut-point for those with more than five years 
certification, but passed the cut-point for those with five or less years certification: 

• #8 — [Evaluation] "Maintain equipment according to manufacturer’s specifications and recommendations" 

• #19 — "Review evaluation data to develop treatment plan" 

• #26 — [Treatment] "Maintain equipment according to manufacturer’s specifications and recommendations" 

• #36 — "Document the procedures and results of the treatment process" 

• #38 — "Establish supervisory procedures that ensure quality patient/consumer care in evaluation and treatment” 

• #42 — "Provide instruction in ethical, legal, and regulatory aspects of the profession" 

Consistent with the main-group analyses, the discrepancy scores for the total of 36 clinical activity 
statements flagged by the subgroup analysis were in the positive (+) direction, indicating that the clinical 
activities should be learned earlier in the educational process. Nevertheless, a difference in trends was observed. 
Practitioners with five or less years certification indicated that 19 of the 29 statements they flagged (66%), 
though learned during the clinical fellowship, should be learned in school. However, practitioners with more 
than five years certification indicated that only 6 of the 35 statements they flagged (17%), though learned during 
the clinical fellowship, should be learned in school. For the latter group of practitioners, most of the discrepancy 
scores (more than 50%) revealed that clinical activities learned after certification, should be learned in school. 

The different trends may reflect how the curriculum of audiology or the structure of the education of audiologists 
has changed over time. 
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Discrepancy Scores: Knowledge Areas 

Practitioners, educators, and clinical-fellowship supervisors . Discrepancy scores were computed 
separately for practitioners, educators, and clinical-fellowship supervisors. These values are presented in 
Appendix L (flagged knowledge areas are highlighted in gray). As before, the discrepancy scores are 
accompanied by the raw percentages of responses to each of the options for the Where Learned and Where 
Should Be Learned rating scales. In total, 73 of the 118 knowledge areas (62%) were flagged by one or more of 
the respondent groups (see Appendix L). The practitioners flagged 61 areas (52%) and the clinical-fellowship 
supervisors flagged 72 areas (61%). In contrast, the educators flagged only five knowledge areas (4%). These 
results are consistent with those obtained for the clinical activity statements, and indicate a difference in 
perceptions between the educators and the other two groups of respondents. (The percent agreement between 
practitioners and clinical-fellowship supervisors was 89%). All discrepancy scores were in the positive (+) 
direction, indicating that the knowledge areas should be acquired earlier in the educational process. 

Clusters of knowledge areas (including subdomains) that failed the 75% cut-point for both practitioners and 
clinical-fellowship supervisors are presented below: 

• #28 - "Counseling" (and all subdomains) 

• #32 - "Electrodiagnostic Test Procedures [non-auditory]" 

• #33 - "Auditory Evoked Potential Assessment" (and all subdomains) 

• #34 ~ "Neurophysiologic Intraoperative Monitoring" (and all subdomains) 

• #39 ~ "Product Dispensing" (and all subdomains) 

• #41 ~ "Hearing .*\id Assessment" (and all but one subdomain- "Electroacoustic Evaluation" passed the cut-point 

for practitioners) 

• #42 - "Assistive Listening System/Device Selection" 

• #43 — "Sensory* Aids Assessment" 

• #44 - "Hearing Aid Fitting/Orientation" (and all subdomains) 

• #47 - "Implant Selection and Rehabilitation" 

A trend was also observed in the discrepancy scores for practitioners. The practitioners indicated that 
approximately 90% of the knowledge areas they flagged, though acquired after certification, should have been 
acquired in school. 

Subgroup analysis . Discrepancy scores were computed separately for practitioners who have been 
certified for five years or less and practitioners who have been certified for more than five years (see Appendix 
M). In total, 69 of the 1 18 knowledge areas (58%) were flagged. Practitioners who have been certified for five 
years or less flagged 46 areas; and practitioners who have been certified for more than five years flagged 69 
areas. (All 46 areas flagged by the practitioners with five or less years of certification were flagged by those 
practitioners with more than five years of certification.) All discrepancy scores were in the positive (+) 
direction, indicating the knowledge areas should be acquired earlier in the educational process. An analysis of 
trends indicated that approximately 70% of the knowledge areas flagged by practitioners with five or less years 
of certification, though acquired after certification, should have been acquired in school. This same trend was 
observed for practitioners with more than five years of certification, but the percentage was much higher, 
approximately 97%. As noted before, this difference may reflect how the curriculum of audiology or the 
structure of the education of audiologists has changed over time, 

IMPLICATIONS 



The Modification of Certification Standards 



The current standards for certification in audiology consist of four components: (a) specific academic 
course work and clinical course work from an accredited program; (b) a graduate degree; (c) a 9-month, 
supervised clinical fellowship; and (d) passing a national examination. The results of this job analysis study may 
be used by the Standards Council as it considers modifying the current certification standards. We recommend 
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that the Council first examine the clinical activity statements and knowledge areas defined by the subject-matter 
experts who participated in this study. Though we have applied certain criteria to evaluate the defined 
performance domain, it is ultimately the Council that needs to come to agreement in what it considers to be 
important and relevant clinical activities and knowledge areas for entry-level audiologists. To this end, the 
Council may elect to apply its own criteria to the judgments obtained in this study as well as to consider the 
results of other studies or judgments made by other professional bodies. 

For purposes of standards modification, we invite the Council to examine, in particular, the judgments 
regarding where clinical activities and knowledge areas are learned and acquired (Tables 12 and 13), These data 
provide valuable insights into the perceived appropriateness of the current professional education and training of 
audiologists. That is, the data nicely illustrate which clinical activities and knowledge areas are learned and 
acquired during the school-based experience (scale values 1 and 2), during the clinical-fellowship experience 
(scale value of 3), and after certification (scale values 4 and 5, highlighted in gray). The Council may examine 
these data to determine if any clinical activities and knowledge areas that are reported to be learned and acquired 
after certification should be incorporated into either the school-based experiences or the clinical-fellowship 
experiences of audiologists. As one example, the results in Table 13 indicate that 72% of the practitioners and 
62% of the clinical-fellowship supervisors reported that knowledge of cerumen management was acquired after 
certification (39% of the educators reported the same). The Council may wish to consider whether or not 
cerumen management should, in fact, be taught before audiologists receive their Certificates of Clinical 
Competence. Any such large-scale modifications to the scope or sequence of professional education and training 
may necessitate that the existing certification standards be reevaluated. 
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Table 12 

Where Learned: Clinical Activity Statements 
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The Redesign of Curriculum 

Job analysis also provides a sound basis for curriculum develop or redesign. All clinical activities that 
are performed and the knowledge required for competent performance of those activities should be part of the 
preparation for professional practice. Educators and other practicing professionals should participate in deciding 
where the relevant knowledge required for professional practice should be learned. This study has provided 
some interesting findings that are important to consider when revising the curriculum. These are discussed 
below. 

1. While there is good agreement among practitioners, clinical-fellowship supervisors, and educators 
concerning the clinical activities and knowledge areas judged important for the competent practice of a 
newly certified audiologist, there was much less agreement between educators and practitioners and 
educators and clinical-fellowship supervisors regarding where these clinical activities and knowledge 
areas should be learned. Educators appear to be very comfortable with where things are learned. They 
perceived that 91% of the clinical activities and 96% of the knowledge areas were being learned in the 
appropriate place. This should not seem surprising. After all, they played the primary role in deciding 
where the clinical activities and knowledge areas would be learned and seem to think that only minor 
“tweaking” is necessary to improve it. Clinical-fellowship supervisors and practitioners, however, 
flagged the majority of clinical activities and knowledge areas, indicating they believed they were not 
being learned in the appropriate place. There was a consistent pattern on the part of both practitioners 
and clinical-fellowship supervisors that more of the clinical activities and knowledge areas should be 
learned in school. 

2. There was a high level of agreement between practitioners who had been certified for five years or less, 
and those who have been certified for more than five years regarding whether or not the clinical 
activities (86%) and knowledge areas (89%) were being learned in the appropriate place. Both 
subgroups believed more learning should take place in school. Although there was good agreement, 
practitioners certified for more than five years tended to flag more clinical activities and knowledge 
areas than did practitioners certified for five years or less. Given the effects of memory and the 
likelihood that the curriculum has changed over the years, it is recommended that, for practitioners, most 
attention be paid to the where-learned ratings provided by those certified for five years or less. 

3. It is important to remember that this report describes the perceptions of various groups of respondents. 

If perceptions differ, it does not necessarily mean that one is correct and the others are incorrect. If one 
were to consider the professional education and training of audiologists in the context of a customer 
service model, we would see the providers of service (educators) satisfied with their product. However, 
the consumers of that product (clinical-fellowship supervisors and practitioners) appear to be having 
some difficulties with it. It would seem that the results of this study would best serve the profession of 
audiology if they are used to start a dialogue among the various constituencies within the profession 
concerning the changes that are desired in professional education and training. 

4. Keep in mind while reviewing the results of the where-learned analyses that the cut-point was set at 
26% for each of the three respondent groups and the two subgroups of practitioners. This means that a 
clinical activity or knowledge statement could be flagged with 74% of the respondents in that group or 
subgroup indicating that the clinical activity or knowledge area was being learned in the appropriate 
place. The cut-point of 26% is clearly an arbitrary one. It could have been set higher. The researchers 
decided to set it at 26% because we believed that represented a meaningful proportion of respondents 
and that their perceptions should be noted when consideration is given to modifying or revising the 
curriculum. 

5. The use of these results requires the application of sound professional judgment. For example, 
practitioners indicated they wanted to learn to perform more supervisory and administrative activities in 
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school. That may not be appropriate or feasible. It might be more reasonable to have specific issues 
related to supervisory and administrative activities left to the individual employer. However, there may 
be some general areas of supervisory knowledge that could be learned in school that would facilitate 
learning on the job. 

6. The job analysis procedures used in this study were sensitive enough to identify differences of opinion 
on the part of educators and the other two respondent groups concerning where clinical activities and 
knowledge areas should be learned. This input should be useful to educators and other decision-makers 
in redesigning or modifying curricula required for competent professional practice. More job-based 
communication between relevant stakeholders should help to improve the preparation and competence of 
newly certified audiologists. 

We believe that these discussions should encompass the entire educational process. This could include 
what is taught at the bachelor’s level and well as the curriculum in graduate professional education. We 
believe, in particular, that there needs to be clear understanding and communication between educators 
and clinical-fellowship supervisors concerning the aspects of professional education and training that are 
to be provided by each group. The results obtained in this study indicate that clinical-fellowship 
supervisors expect graduates of professional schools to be able to perform more clinical activities and to 
know more content areas, before the start of the clinical fellowship. Recently certified audiologists also 
indicated that they believed many of the things they learned during their clinical fellowship should have 
been learned in school. To the extent possible, there should be a well-articulated transition from one 
stage of education and training to the next. It seems reasonable to expect that a newly certified 
audiologist be competent to engage in independent practice. After that, it would appear that professional 
mechanisms should be put in place to provide opportunities for audiologists to maintain their 
competence and update their knowledge through programs of continuing education, 

7. We recommend that a study of curricula be performed if judged to be appropriate and/or feasible. 
Furthermore, programs may demonstrate where clinical activities and knowledge areas identified as 
reflecting the core of the profession by the Standards Council are taught. If these items are not taught 
or included in the curriculum, then educators may be asked to consider revising their curriculum to 
include this additional content. 

The Design of Certification Examinations 

The Standards for Educational and Psychological Testing (American Psychological Association et al,, 
1985) emphasizes the importance of job analysis as a basis for demonstrating the validity of a licensure or 
certification examination. Job analysis results can also be used to provide a rationale for explaining to others 
why certain content was included in a certification examination and in documenting why that content is job- 
related. Using the results of this study we can demonstrate the following: 

1. The domain of clinical activity statements and knowledge areas was developed by subject-matter experts 
from a variety of practice settings. The experts had representation by race/ethnicity, gender, and 
geographic region. The domain they developed was placed in a job analysis survey with appropriate 
rating scales and administered to approximately 3,600 practicing audiologists across the country. More 
than 1,300 audiologists responded. Analyses indicated that 57 of the 58 clinical activity statements were 
judged to be part of the job of a newly certified audiologist and that all 118 knowledge statements were 
needed for competent performance. Data were presented indicating that practitioners, clinical-fellowship 
supervisors, and educators all believed that the content included in the inventory had more than 
adequately covered the domain of clinical activities and knowledge areas that a newly certified 
audiologist was expected to be able to perform and know. The most important clinical activity 
statements and knowledge areas were identified and there was strong agreement among practitioners, 
clinical-fellowship supervisors, and educators on these clinical activities and knowledge areas. In 
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addition, analysis of the responses from relevant subgroups of practitioners were also conducted. A 
subset of clinical activity statements (69%) and knowledge areas (68%) were judged to be important by 
each of the three respondent groups and all relevant subgroups of practitioners. These clinical activity 
statements and knowledge areas provide a sound basis for use in setting test specifications. 

2. Because certification examinations cannot measure everything, the pool of important clinical activity 
statements and knowledge areas — those passing the 3.50 cut-point — should be considered as the 
primary pool from which test specifications are built. Building test specifications requires the exercise 
of sound professional judgment. If test development committees composed of practicing audiologists 
decide that several of the clinical activity statements and knowledge areas that were not universally 
endorsed as being important must be included in the test specifications, then a compelling, written 
justification must be provided. Otherwise, the results of the job analysis study provide a sound 
defensible rationale for building test specifications. 

3. Test questions and formats need to be developed to measure each part of the test specifications. 
Questions written to those specifications need to be linked back to the specifications by the question 
writer as well as by an independent group of practitioners. Linkages from test questions to test 
specifications, and from test specifications to the job analysis, provide a strong network for use in 
documenting the validity of certification examinations. 
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Appendix A 



Subject-Matter Experts 



Subject Matter Expert Panel 



Martin Robinette 
Mayo Clinic L-5 
Audiology Section 
200 First St. SW 
Rochester, MN 55905 


Dr. Allan 0. Diefendorf 
12222 Castle Court 
Carmel, IN 46033 


Patricia McCarthy 
Dept. Of Comm. Disorders 
& Sciences 

Rush Presbyterian-St. Luke’s 
Medical Center 
1653 W. Congress Parkway 
Chicago, IL 60612 


Angela Loavenbruck 
500 New Hempstead Rd. 
New City, NY 10956 


Craig Newman 
The Cleveland Clinic 
Otolaryngology & Comm. 
Disorders/A-71 
9500 Euclid Ave. 
Cleveland, OH 44195 


Janice Ray Trent 
Dept. Of Speech-Lang.-Hearing 
Temple University 
Philadephia, PA 19122 


David Alan Fabry 
Mayo Clinic 
200 First Street SW 
Rochester, MN 55905 


Michael Gorga 

Boystown Nat. Research Hosp. 
555 N. 30th Street 
Omaha, NE 68131 


Rena H. Glaser 
3M Center 
Bldg. 220-3 W-05 
St. Paul, MN 55144-1000 


Lida G. Wall 

Div. Of Spch. & Hearing Sciences 
The Ohio State University 
110 Pressey Hall 
1070 Carmack Road 
Columbus, OH 43210 
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Ronald Jones 
52 W. 78th Place 
Chicago, IL 60620 



Paul Kileny 

2344 Dundee 

Ann Arbor, MI 48103 



Alison May Grimes 
Poudre Valley Hearing Ctr. Inc. 
1247 Riverside Ave., Suite 3 
Ft. ColUns, CO 80524 



Anita Pikus 

10324 Thombush Lane 

Bethesda, MD 20814 
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Pilot Test Participants 



Eighteen job experts were selected at random to participate in the pilot survey. In addition, 
members of the following Allied and Related Professional Organizations (ARPOs) and Special 
Interest Divisions (SIDs) were invited to participate: 



Allied and Related Professional Organizations 

Academy of Dispensing Audiologists 
Academy of Rehabilitative Audiology 
Air Force Audiology Association 
American Academy of Audiology 
American Auditory Society 
Educational Audiology Association 
Military Audiology Association 
National Hearing Conservation Association 
Navy Audiology Society 



Special Interest Divisions 

Hearing and Hearing Disorders - Physiology & Psychoacoustics 
Aural Rehabilitation & Its Instrumentation 
Hearing Conservation & Occupational Audiology 
Hearing and Hearing Disorders in Childhood 
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PILOT TEST QUESTIONNAIRE 






Name (please print) 



Purpose: The purpose of the "pilot test questionnaire" is to obtain your feedback concerning the quality of the job 
analysis survey. We want to make certain that the survey is well designed and relatively easy to complete before we 
mail it to large numbers of practicing professionals similar to yourself. 

Instructions: After you have completed the job analysis survey, please answer the following questions. Return the 
job analysis survey and this "pilot test questionnaire" using the enclosed postage-paid envelope. Thank you, in 
advance, for your cooperation. We may be contacting you by telephone to follow-up on some of your responses. 



A. Cover Letter 

1. Is the letter clearly written? YES NO 

2. If you received this letter in the mail, would you be motivated to complete the job analysis survey? 

YES NO 

3. How would you change the cover letter? (Feel free to make your conunents below or directly on 
the cover letter) 



B. Job Analysis Survey 

1 . How long did it take you to complete the survey? (minutes) 

2. Are the introduction and directions clear? YES NO 

If not, how would you change them? (Feel free to make your conunents 
below or directly on the survey.) 
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3 , 



Which task statements and/or knowledge areas, if any, are not clear or understandable? 
(Feel free to make your comments below or directly on the survey.) 



4. Are the rating scales understandable? YES NO 

If not, how would you change them? (Feel free to make your comments 
below or directly on the survey.) 



5. Are the background information questions clear and appropriate? 

If not, how would you change them? (Feel free to make your comments 
below or directly on the survey.) 
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Appendix D 



Job Analysis Survey [Practitioners] 



A National Study of the 
Practice of Audiology 

[Practitioners] 



An Inventory 

of 

Clinical Activities and Knowledge Areas 

for the 

Certified Audiologist 



A job analysis conducted on behalf of the 
American Speech-Language-Hearing Association (ASHA) 




Educational 
Testing Service 

April 1995 
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INTRODUCTION 



The clinical activity statements, knowledge areas, and rating scales that form this job analysis survey were developed 
by a committee of 14 audiologists representing a range of practice settings. The survey was then pilot tested on an 
additional 37 professionals in the field of audiology. 

This job analysis survey has been mailed to more than 4,000 professionals, like yourself in the field of audiology. 
Because the information from this job analysis survey will inform so many important decisions, it is critical that ail 
those who receive a survey complete it. The quality of the information from this survey is directly related to the 
number of persons who complete and return their surveys. The survey should take no longer than 45 minutes to 
complete. 

The job analysis survey consists of three parts: 



PART I: Clinical Activities - The purpose of Part I is to determine what clinical activities newly certified 

audiologists should be able to do. In this section you will find activity statements that reflect the 
major job responsibilities of Evaluation , Treatment , and Related Professional Activities . 

PART II: Knowledee Areas - The purpose of Part II is to determine the knowledge areas believed necessary 

in order to perform the clinical activities listed in Part I. 

PART ni: Background Information - Demographic information needed to describe the characteristics of 

those returning completed surveys and for analysis of survey responses. 



For parts I and II (CUnical Activities and Knowledge Areas) you will be asked to respond to each statement or area 
on three rating scales: (1) Importance, (2) Where Learned or Acquired, and (3) Where Should Be Learned or 
Acquired. Each rating scale is fully explained in the appropriate part of the survey; for each scale you will be asked 
to circle the one scale point that best represents your judgment. 

To familiarize yourself with the areas and statements, you may wish to scan Part I and Part II before making your 
rating judgements. 

Please return the completed survey in the enclosed envelope no later than May 15, 1995, 



Thank you, in advance, for taking the time to complete and return this critical job analysis survey. 
Highlights of the survey will be published in Asha magazine. 
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PARTI: CLINICAL ACTIVITIES 

[Practitioners] 



Listed below are the scales we would like you to use to rate the clinical activities that newly certified audiologists 
might perform. If you believe a particular activity is not performed, circle ”0" on the importance scale, and then 
move on to the next activity statement. If you believe an activity is performed, complete all three rating scales before 
moving on to the next activity statement. 



RATING SCALES 



IMPORTANCE: How important is the correct performance of this clinical activity for a newly certified 

audiologist to be considered competent for independent practice? (Circle one number.) 



(0) THIS ACTIVITY IS NOT PERFORMED; SKIP TO NEXT ACTIVITY STATEMENT 



( 1) NOT IMPORTANT (This activity may need to be performed, but it is not related to the competent 

performance of a newly certified audiologist.) 

(2) MARGINALLY IMPORTANT (This activity needs to be performed, but it is only marginally related to the competent 

performance of a newly certified audiologist.) 



(3) MODERATELY IMPORTANT (This activity is related to competent performance, but it is not one of the more 

important activities that needs to be performed by a newly certified audiologist.) 



(4) IMPORTANT 



(This activity is related to competent performance, and is among the more important 
activities that needs to be performed by a newly certified audiologist.) 



(5) VERY IMPORTANT (This activity is highly related to competent performance, and is one of the critical 

activities that needs to be performed by a newly certified audiologist.) 



WHERE LEARNED: Where did you, as a newly certified audiologist, learn to perform this activity?(Circle one 

number.) 

(1) SCHOOL - CLASSROOM 

(2) SCHOOL - PRACnCUM 

(3) CLINICAL FELLOWSHIP 

(4) ON THE JOB, AFTER CERTIFICATION 

(5) CONTINUING EDUCATION, AFTER CERTIHCATION 



WHERE SHOULD BE LEARNED: Where would you, as a newly certified audiologist, have preferred to have 

learned to perform this activity? (Circle one number.) 



(1) SCHOOL - CLASSROOM 

(2) SCHOOL - PRACnCUM 

(3) CLINICAL FELLOWSHIP 

(4) ON THE JOB, AFTER CERTIHCATION 

(5) CONTINUING EDUCATION, AFTER CERTIHCATION 
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PART II: KNOWLEDGE 

[Practitioners] 

Listed below are the scales we would like you to use to rate the knowledge areas that may be important to newly 
certified audiologists. If you believe a particular knowledge area is not important, circle "0" on the importance scale, 
and then move on to the next knowledge area statement. If you believe a knowledge area is important, complete all 
three rating scales before moving on to the next knowledge area statement. 

RATING SCALES 



IMPORTANCE: 



How important is this knowledge area for a newly certified audiologist to be considered 
competent for independent practice? (Circle one number.) 



( 0 ) 

( 1 ) 

( 2 ) 

( 3 ) 

(4) 

(5) 



THIS KNOWLEDGE AREA IS NOT NEEDED; SKIP TO NEXT KNOWLEDGE AREA 

NOT IMPORTANT (This knowledge area may be needed, but it is not related to the competent performance 

of a newly certified audiologist.) 

MARGINALLY IMPORTANT (This knowledge area is needed, but it is only marginally related to the competent 

performance of a newly certified audiologist.) 

MODERATELY IMPORTANT (This knowledge area is related to the competent performance of a newly certified 

audiologist, but it is not one of the more important knowledge areas.) 



IMPORTANT 



VERY IMPORTANT 



(This knowledge area is related to the competent performance of a newly certified 
audiologist, and is among the more important knowledge areas.) 

(This knowledge area is highly related to the competent performance of a newly 
certified audiologist, and is one of the critical knowledge areas.) 



WHERE LEARNED: 



Where did you, as a newly certified audiologist, acquire this knowledge area? (Circle 
one number.) 



(1) SCHOOL -CLASSROOM 

(2) SCHOOL - PRACnCUM 

(3) CLINICAL FELLOWSHIP 

(4) ON THE JOB, AFTER CERTinCATION 

(5) CONTINUING EDUCATION, AFTER CERTIHCATION 



WHERE SHOULD BE LEARNED: Where would you, as a newlv certified audiologist, have preferred to have acquired this 

knowledge area? (Circle one number.) 

(1) SCHOOL -CLASSROOM 

(2) SCHOOL - PRACnCUM 

(3) CLINICAL FELLOWSHIP 

(4) ON THE JOB, AFTER CERTIHCATION 

(5) CONTINUING EDUCATION, AFTER CERTIHCATION 
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Adequacy of Coverage 



How well do the Clinical Activity statements listed in Part I cover what a newly certified audiologist should be able 
to do? (Please circle one) 




What important clinical activities, if any, are not covered in Part I? 



How well do the Knowledge Area statements listed in Part II cover what a newly certified audiologist should know? 
(Please circle one) 




What important knowledge areas, if any, are not covered in Part II? 
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PART III l SURVEY PARTICIPANT 
BACKGROUND mFORMATION 



The information you provide in this section is completely confidential and will be used for research purposes only. Please 
answer each question by circling the number or filling in the blank that most closely describes you or your professional activities. 
Please mark only one response for each question. 



1 . What is your gender? (Circle one number.) 

1. Male 

2. Female 

2. Which of the following best describes your race/ethnicity? 
(Circle one number.) 

1 . American Indian/ Alaskan Native 

2. Asian or Pacific Islander 

3. Hispanic 

4. African American (non-Hispanic) 

5. White (non-Hispanic) 

3. How many years have you been practicing as an ASHA- 
certified audiologist? (Circle one number.) 

1 . 3 or less 

2. 4 to 6 

3. 7 to 9 

4. 10 to 12 

5. 13 to 15 

6. 16 or more 

4. In what region of the country do you work? 

(Circle one number.) 

1 . Northeast 

2. Central 

3. Southern 

4. Far West 

5. Which of the following best describes your current 
employment status? (Circle one number.) 

1 . Employed full-time (30 hrs/week or more) 

2. Employed part-time (less than 30 hrs/week) 

3. Not employed 

4. Retired 

6. In what year did you receive your certificate 
of clinical competence? (Fill in the year.) 

19 



7. What is your highest educational level? (Circle 
one number.) 

1. Bachelor’s 

2. Master’s 

3. Doctorate 

8. In what academic area is your highest 
educational degree? (Circle one number.) 

1. Audiology 

2. Speech-Language Pathology 

3. Speech and Hearing Sciences 

4. Other Health Related 

5. Other Non-Health Related 

9. In what year did you receive your highest 
educational degree? (Fill in the year.) 

19 

10. In which employment activity do you spend 
MOST of your time? (Circle one number.) 

1. Clinical Service Provider 

2. Educator (college/university) 

3. Researcher 

4. Consultant 

5. Administrator/Manager 

6. Chair/Department Head/Director 

7. Supervisor of Clinical Activity 

11. In which employment setting do you spend MOST 
of your time? (Circle one number.) 

1 . Elementary school 

2. Secondary school 

3. Special school 

4. College/University 

5. Hospital 

6. Residential healthcare facility 

7. Private physician’s office 

8. SLP’s or AUD’s office 

9. Own office 

10. Other (specify): 



Thank you for taking the time to complete this 
questionnaire. Please return it using the 
enclosed envelope or send it to: 



Educational Testing Service 
Mail Stop 12-T 
Rosedale Road 
Princeton, NJ 08541 
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35. Follow-up on referrals/recoirimendations 

36. Document the procedures and results 

37. Maintain patient/consumer records 
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57. Conduct and/or participate in research 

58. Update clinical/professional knowledge/ skill 
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Appendix F 



Mean Importance Ratings: Clinical Activity Statements 



Mean Importance Ratines 
CLINICAL ACTIVITY STATEMENTS 







Educator 


Supervisor 


Pr ac t it loner 






N=63 


N=126 


Nsll92 


EVALUATXON 








1. 


Identify high risk individuals. 


4.60 


4.50 


4.38 


2. 


Screen for hearing deficits 


4.56 


4.50 


4.39 


3. 


Screen speech-language and other factor 




?:11 


MM. 


4. 


Gather, review, evaluate information 


4.46 


4.38 


4.28 


5. 


Obtain in-depth case history 


4.62 


4.45 


4.45 


6. 


Perform otoscopic exam 


4.59 


4.74 


4.76 


7 . 


Remove cerumen by variety of techniques 


MM 


im 


MMM 


8. 


Maintain equipment 


4.16 


4.03 


4.02 


9. 


Calibrate equipment 


3.74 


3.50 


Sii 


10. 


Administer screening and asses, measures 


4.46 


4.39 


4.42 


11. 


Eval . chgs. in neural tissue during surgery 


MM 


MM 


MM 


12. 


Document, procedures/results of eval. process 


4.78 


A.62 


4.71 


13. 


Interpret results of evaluation 


4.90 


4.87 


4.91 


14. 


Generate recommendations 


4.89 


4.87 


4.85 


15. 


Communicate results and recommendations 


4.78 


4.76 


4.76 


16. 


Write formal reports 


4.70 


4.64 


4.56 


17. 


Monitor patient /consumer status 


4.35 


4.21 


4.16 


18. 


Maintain patient /consumer records. 


4.64 


4.60 


4.63 


TREATMENT 








19. 


Review eval. data/develop treatment plan 


4.60 


4.48 


4.56 


20. 


Develop rapport with patient /consumer 


4.58 


4.58 


4.54 


21. 


Communicate results/discuss prognosis 


4.58 


4.65 


4.62 


22. 


Provide ongoing counseling 


4.49 


4.48 


4.34 


23. 


Develop management strategies 


4.46 


4.11 


4.10 


24. 


Participate in case coordination 


4.09 


3.80 


3.78 


25. 


Communicate treatment plans for appr. 


4.19 


3.77 


3.78 


26. 


Maintain equipment 


4.25 


4.15 


4.14 


27. 


Calibrate equip. to accepted standards 


3.95 


3.58 


3.56 


28. 


Select methods, instrumentation, etc. 


4.65 


4.39 


4.49 


29. 


Recommend prosthetic/assistive devices 


4.82 


4.69 


4.64 


30. 


Establish methods to monitor treatment 


4.36 


3.93 


3.93 


31. 


Monitor and summ. treatment outcomes 


4.48 


3.98 


4.00 


32. 


Provide, info, about treatment outcomes 


4.37 


4.23 


4.11 


33. 


Establish treatment discharge criteria 


4.30 


3.91 


3.93 


34. 


Make referrals for add. eval. and trtmnt. 


4.28 


4.06 


4.14 


35. 


Follow-up on ref errals/ recommendations 


4.25 


4.05 


4.02 


36. 


Document the procedures and results 


4.61 


4.43 


4.46 


37. 


Maintain patient /consumer records 


4.62 


4.61 


4.61 



BEST COPY AVAILABLE^ 

F-3 




RELATED PROFESSIONAL ACTIVITIES 



Educator 

N»83 



Supervisor 

N>126 



Practitioner 

N»1192 



[ Supe rvi sory ] 

38. Establish supervisory procedures. 

39. Deliver direct patient care 

40. Provide supervisees w/practical experiences 

41. Provide supervisees with feedback 

42. Provide ethical, legal & regulatory instructn 

43. Provide instrctn in rpt. writing/recrd keepng 

[Legislative ] 

44. Follow laws, regulations, respective mandates 

45. Promote legislation and regulations 

46. Promote legislation beneficial to the profssn 

[Administrative] 

47. Advocate for direct third-party payment 

48. Identify unmet programmatic needs 

49. Implement public information programs 

50. Seek current financial support Info. 

51. Oversee efficient administration activities 

52. Maintain compliance with calibration standard 

53. Introduce and implement new procedures 

54. Promote cultural diversity in staff 

55. Identify multi -cultural /under served populatns 

56. Develop programs for conservation of hearing. 

OTHER PROFESSIONAL ACTIVITIES 

57 . Conduct and/or participate in research 

58. Update clinical /professional knowledge/ skill 



3-63 3.60 

3.80 3.66 3.69 

3.81 3.85 3.70 

3.92 3.86 3.76 

3.83 3.75 3.57 

3.86 3.81 3.77 



4.46 4.46 4.53 
3.70 3.65 3.52 
3.74 3.69 3.57 



3.64 3.79 3.62 

iSI 

iiil ^53 3.53 

3.77 3-^ Sm 

iiii ImI 

4726 47 07 4.10 

4.01 3.79 3.79 

WM ^5 2 J7| 

igi igi 

3.85 3.70 3.73 



2^6^ 

4.77 4.66 4.66 
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Appendix G 



Mean Importance Ratings: Clinical Activity Statements - Practitioner Subgroups 
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Mean Importance Ratings -Gender 
CLINICAL ACTIVITY STATEMENTS 







Male 


Female 






Nal80 


N»1009 


EVALUATION 






1. 


Identify high risk individuals. 


4.40 


4.38 


2. 


Screen for hearing deficits 


4.23 


4.41 


3. 


Screen speech- language and other factor 




3.21 


4. 


Gather, review, evaluate information 


4.27 


4.29 


5. 


Obtain in-depth case history 


4.39 


4.46 


6. 


Perform otoscopic exam 


4.71 


4.77 


7. 


Remove ceriimen by variety of techniques 


3.68 


2:£|i 


8. 


Maintain equipment 


4.03 


4.02 


9. 


Calibrate equipment 


3.56 


MM 


10. 


Administer screening and asses, measures 


4.42 


4.42 


11. 


Eval. chgs. in neural tissue during surgery 


WM 


WM 


12. 


Document, procedures /results of eval. process 


4.59 


4.73 


13. 


Interpret results of evaluation 


4.88 


4.92 


14. 


Gener a t e r ecommenda t i ons 


4.82 


4.85 


15. 


Communicate results and recommendations 


4.74 


4.77 


16. 


Write formal reports 


4.53 


4.56 


17. 


Monitor patient /consumer status 


4.12 


4.18 


18. 


Maintain patient /consumer records. 


4.57 


4.64 


TREATMENT 






19. 


Review eval. data/develop treatment plan 


4.56 


4.56 


20. 


Develop rapport with patient/consumer 


4.46 


4.56 


21. 


Communicate results/discuss prognosis 


4.58 


4.63 


22. 


Provide ongoing counseling 


4.25 


4.36 


23. 


Develop management strategies 


4.00 


4.12 


24. 


Participate in case coordination 


3.69 


3.80 


25. 


Communicate treatment plauis for appr . 


3.76 


3.78 


26. 


Maintain equipment 


4.11 


4.14 


27. 


Calibrate equip. to accepted standards 


3.69 


3.53 


28. 


Select methods, instrumentation, etc. 


4.53 


4.49 


29. 


Recommend pros the tic /assistive devices 


4.70 


4.63 


30. 


Establish methods to monitor treatment 


3.92 


3.93 


31. 


Monitor and summ. treatment outcomes 


3.95 


4.02 


32. 


Provide, info, about treatment outcomes 


4.05 


4.13 


33. 


Establish treatment discharge criteria 


3.83 


3.96 


34. 


Make referrals for add. eval. and trtmnt. 


4.05 


4.16 


35. 


Follow-up on referrals/recommendations 


3.94 


4.04 


36. 


Document the procedures and results 


4.37 


4.48 


37. 


Maintain patient /consumer records 


4.55 


4.63 



Male Female 

N=180 N=1009 

RELATED PROFESSIOKAL ACTIVITIES 



[Supervisory] 



38. 


Establish supervisory procedures. 


3.60 


mm 


39. 


Deliver 


direct patient care 


3.83 




40. 


Provide 


supervisees w/practical experiences 


3.86 


3.67 


41. 


Provide 


supervisees with feedback 


3.83 


3.74 


42. 


Provide 


ethical, legal & regulatory instructn 


3.72 


3.54 


43 . 


Provide 


instrctn in rpt. writing/recrd keepng 


3.97 


3.73 


[Legislative] 








44. 


Follow laws# regulations, respective mandates 


4.39 


4.55 


45. 


Promote 


legislation and regulations 


3.66 


3.50 


46. 


Promote 


legislation beneficial to the profssn 


3 . 84 


3.53 



[Administrative] 



47 . 


Advocate for direct third-party payment 


4.05 


3.52 


48. 


Identify unmet programmatic needs 




mi 


49. 


Implement public information programs 


3.59 


3.52 


50. 


Seek current financial support Info. 


3.56 


E!MM 


51. 


Oversee efficient administration activities 


:3xri?; 


ml 


52. 


Maintain compliance with calibration standard 


4.17 


4.09 


53 . 


Introduce and implement new procedures 


3.97 


3.75 


54. 


Promote cultural diversity in staff 




2f83 


55. 


Identify multi -cultural /underserved populatns 


EMM 


EMS 


56. 


Develop programs for conservation of hearing. 


3.91 


3.70 


OTHER PROFESSIONAL ACTIVITIES 






57. 


Conduct and/or participate in research 


mi 




58. 


Update clinical /professional knowledge/ skill 


4.67 


4.65 



Mean Importance Ratings - Race/Ethnicity 

CLINICAL ACTIVITY STATEMENTS 



White 



Non- 







N=1126 


evaluation 




1. 


Identify high risk individuals. 


4.38 


2. 


Screen for hearing deficits 


4.39 


3. 


Screen speech-language and other factor 




4. 


Gather, review, evaluate information 


4.28 


5. 


Obtain in-depth case history 


4.45 


6. 


Perform otoscopic exsmi 


4.76 


7 . 


Remove cerumen by variety of techniques 


3j0l 


8. 


Maintain equipment 


4.03 


9. 


Calibrate equipment 




10. 


Administer screening and asses . measures 


4.42 


11. 


Eval. chgs. in neural tissue during surgery 


SIS 


12. 


Document, procedures /results of eval. process 


4.71 


13. 


Interpret results of evaluation 


4.91 


14. 


Generate recommendations 


4.85 


15. 


Communicate results and recommendations 


4.76 


16. 


Write formal reports 


4.56 


17. 


Monitor patient /consumer status 


4 . 16 


18. 


Maintain patient /consumer records. 


4 . 63 


TREATMENT 





19. Review eval. data/develop treatment plan 

20. Develop rapport with patient /consumer 

21. Communicate results /discuss prognosis 

22. Provide ongoing coimseling 

23. Develop meinagement strategies 

24. Participate in case coordination 

25. Communicate treatment plans for appr. 

26. Maintain equipment 

27. Calibrate equip. to accepted standards 

28. Select methods, instrumentation, etc. 

29. Recommend prosthetic/assistive devices 

30. Establish methods to monitor treatment 

31. Monitor and summ. treatment outcomes 

32. Provide, info, about treatment outcomes 

33. Establish treatment discharge criteria 

34. Make referrals for add. eval. and trtmnt. 

35. Follow-up on ref errals/ recommendations 

36. Document the procedures and results 

37. Maintain patient/consumer records 



4.56 

4.55 

4.63 
4.34 
4.09 

3.78 

3.79 
4.14 
3.54 
4.50 

4.64 
3.93 
4.00 

4.12 
3.93 

4.13 
4.02 
4.46 
4.61 



RELATED PROFESSIONAL ACTIVITIES 



[Supervisory] 

38. Establish supervisory procedures. 

39. Deliver direct patient care 

40. Provide supervisees w/practical experiences 



G-5 




122 



White 

N«57 



4.51 

4.24 

1111 

4.25 
4.46 
4.81 

fr-S 
3 .Ti 

3.80 

4.40 

iiffi 

4.59 

4.93 

4.79 

4.72 

4.53 

4.22 

4.57 



4.48 

4.48 

4.59 

4.35 

4.22 

3.81 

3.53 

4.06 
3.86 
4.43 
4.55 
4.02 
4.02 

4.07 
4.05 
4.20 
4.15 
4.42 
4.60 



3 .71 
3.66 
3.97 



White Non< 

N»1126 



41. 


Provide 


supervisees with 


feedback 


3.75 


42 . 


Provide 


ethical , 


legal & 


regulatory instructn 


3.56 


43. 


Provide 


instrctn 


in rpt . 


writing/recrd keepng 


3.76 



[Legislative] 

44. Follow laws, regulations, respective mandates 4.52 

45. Promote legislation and regulations 3.52 

46. Promote legislation beneficial to the profssn 3.58 

[Administrative] 



47. Advocate for direct third-party payment 3.62 

48. Identify unmet programmatic needs 

49. Implement public information programs 3.52 

50. Seek current financial support Info. 3.41 

51. Oversee efficient administration activities 

52. Maintain compliance with calibration standard 4.10 

53. Introduce and implement new procedures 3.78 

54. Promote cultural diversity in staff 2:f7-5 

55. Identify multi-cultural/underserved populatns 

56. Develop programs for conservation of hearing. 3.73 



OTHER PROFESSIONAL ACTIVITIES 

57. Conduct and/or participate in research 

58. Update clinical/professional knowledge/ skill 4.66 



G-6 



‘White 

N=57 

3.91 

3.73 

3.80 



4.61 

3.65 

3.53 



3.67 

3.56 

3.80 

isi. 

4.14 

3.93 

MM 

3. 85 
3.77 



MM 

4.62 
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Mean Importance Ratings - Practice Setting 
CT JNTCAT. ACTIVITY STATEMENTS 
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Mean Importance Ratings - Years Certified 
CLINICAT. ACTiyiTY STATEMENTS 







< = 5 


> 5 






N=341 


N=847 


EVALUATION 






1. 


Identify high risk individuals. 


4.36 


4.39 


2. 


Screen for hearing deficits 


4.34 


4.41 


3. 


Screen speech- language and other factor 






4. 


Gather, review, evaluate information 


4.33 


4.26 


5. 


Obtain in-depth case history 


4.47 


4.44 


6. 


Perform otoscopic exam 


4.77 


4.77 


7. 


Remove cerumen by variety of techniques 






8 . 


Maintain equipment 


3.96 


4 . 05 


9. 


Calibrate equipment 


IB 


iSl 


10. 


Administer screening and asses, measures 


4.30 


4 . 46 


11. 


Eval. chgs. in neural tissue during surgery 




Mil 


12 . 


Document, procedures /results of eval. process 


4.70 


4.71 


13 . 


Interpret results of evaluation 


4.92 


4 . 90 


14. 


Generate recommendations 


4.86 


4 . 84 


15. 


Communicate results and recommendations 


4.76 


4.77 


16. 


Write formal reports 


4.53 


4.57 


17. 


Monitor patient /consumer status 


4.17 


4 . 16 


18. 


Maintain patient /consumer records. 


4.62 


4 . 63 



TREATMENT 



19. Review eval. data/develop treatment plan 

20. Develop rapport with patient/consumer 

21. Communicate results/discuss prognosis 

22 . Provide ongoing counseling 

23. Develop management strategies 

24 . Participate in case coordination 

25. Communicate treatment plans for appr . 

26. Maintain equipment 

27. Calibrate equip. to accepted standards 

28. Select methods, instrumentation, etc. 

29. Recommend prosthetic/assistive devices 

30. Establish methods to monitor treatment 

31. Monitor and summ. treatment outcomes 

32. Provide, info, about treatment outcomes 

33. Establish treatment discharge criteria 

34. Make referrals for add. eval. and trtmnt. 

35. Follow-up on ref errals/ recommendations 

36. Document the procedures and results 

37. Maintain patient/consumer records 



4.57 


4.55 


4.53 


4.55 


4.66 


4.61 


4.33 


4.35 


4.10 


4.10 


3.74 


3.80 


3.69 


3.81 


4.10 


4.15 


MM. 


3.61 


4.49 


4.49 


4.62 


4.65 


3.95 


3.93 


4.01 


4.01 


4.06 


4.14 


3.88 


3.96 


4.17 


4.13 


4.06 


4.01 


4.52 


4.44 


4.59 


4.63 



RELATED PROFESSIONAL ACTIVITIES 



[ Supervisory] 

38. Establish supervisory procedures. 

39. Deliver direct patient care 

40. Provide supervisees w/practical experiences 

41. Provide supervisees with feedback 





'Sil 


3.11 


T.'?9 


3.69 


3.70 


3.79 


3.74 



G-10 



42. Provide ethical, legal & regulatory instructn 

43. Provide instrctn in rpt. writing/recrd keepng 

[Legislative] 

44. Follow laws, regulations, respective mandates 

45. Promote legislation and regulations 

46. Promote legislation beneficial to the profssn 

[Administrative] 

47 . Advocate for direct third-party payment 

48. Identify unmet programmatic needs 

49. Implement public information programs 

50. Seek current financial support Info. 

51. Oversee efficient administration activities 

52. Maintain compliance with calibration standard 

53. Introduce and implement new procedures 

54. Promote cultural diversity in staff 

55. Identify multi -cultural /underserved populatns 

56. Develop programs for conservation of hearing. 

OTHER PROFESSIONAL ACTIVITIES 

57 . Conduct and/or participate in research 

58. Update clinical /prof essional knowledge/ skill 



< = 5 
N=341 

3’i;4'9 

3.75 



4.57 
3.51 

3.57 



3:S4;9^ 

3.54 

WM 

•jjjog 

4.03 

3.70 

3.69 



4766 



> 5 
N=847 

3.60 

3.77 



4.51 

3.53 

3.58 



3.66 

'WM 

3.53 

Mm 

Mm 

4.12 

3.82 

3.75 



WM 

4766 
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Mean Importance Ratings - Hiehest Educational Level 
CLINICAL ACTIVITY STATEMENTS 



Master 

N=1148 

EVALUATION 



1. Identify high risk individuals. 4.38 

2. Screen for hearing deficits 4.38 

3. Screen speech- language and other factor 

4. Gather, review, evaluate information 4.27 

5. Obtain in-depth case history 4.45 

6. Perform otoscopic exam 4.77 

7 . Remove cerumen by variety of techniques 

8. Maintain equipment 4.01 

9. Calibrate equipment ilMS 

10. Administer screening cuid asses, measures 4.41 

11. Eval. chgs . in neural tissue during surgery 

12. Document, procedures /results of eval. process 4.71 

13. Interpret results of evaluation 4.91 

14. Generate recommendations 4.84 

15. Communicate results euid recommendations 4.76 

16. Write formal reports 4.56 

17. Monitor patient/consumer status 4.16 

18. Maintain patient /consumer records. 4.63 



TREATMENT 



19. Review eval. data/develop treatment plain 4.55 

20. Develop rapport with patient/consumer 4.54 

21. Communicate results /discuss prognosis 4.62 

22. Provide ongoing counseling 4.34 

23. Develop management strategies 4.09 

24. Participate in case coordination 3.77 

25. Communicate treatment plauis for appr. 3.76 

26. Maintain equipment 4.13 

27. Calibrate equip. to accepted standards 3.53 

28. Select methods, instrumentation, etc. 4.49 

29. Recommend prosthetic/assistive devices 4.64 

30. Establish methods to monitor treatment 3.92 

31. Monitor and summ. treatment outcomes 3.99 

32. Provide, info, about treatment outcomes 4.11 

33. Establish treatment discharge criteria 3.92 

34. Make referrals for add. eval. and trtmnt. 4.13 

35. Follow-up on ref errals/ recommendations 4.01 

36. Document the procedures and results 4.46 

37. Maintain patient/consumer records 4.61 



RELATED PROFESSIONAL ACTIVITIES 
[Supervisory] 

38. Establish supervisory procedures. 



Doctorate 

N=44 



4.58 

4.45 

mi 

4.57 

4.52 

4.66 

liil 

4.31 

4.00 

4.61 

2lp 

4.72 

4.88 

4.88 

4.81 

4.62 
4.19 

4.63 



4.77 

4.60 

4.74 

4.45 

4.30 

3.98 

4.07 
4.30 

4.08 
4.49 
4.71 
4.15 
4.36 
4.27 
4.33 
4.27 
4.24 
4.53 
4.70 



3.68 



Master 

N=1148 



39. Deliver direct patient care 3.68 

40. Provide supervisees w/practical experiences 3.69 

41. Provide supervisees with feedback 3.74 

42. Provide ethical/ legal & regulatory instructn 3.55 

43. Provide instrctn in rpt. writing/recrd keepng 3.75 



[Legislative ] 



44. Follow lawS/ regulations/ respective mandates 4.53 

45. Promote legislation and regulations 3.51 

46. Promote legislation beneficial to the profssn 3.56 

[ Admini s t ra t i ve ] 

47. Advocate for direct third-party payment 3.60 

48. Identify unmet programmatic needs 

49. Implement public information programs 3.54 

50. Seek current financial support Info. ijflS 

51. Oversee efficient administration activities 

52. Maintain compliance with calibration standard 4.10 

53. Introduce and implement new procedures 3.78 

54. Promote cultural diversity in staff 

i* 55. Identify multi -cultural /underserved populatns 

56. Develop programs for conservation of hearing. 3.74 



OTHER PROFESSIONAL ACTIVITIES 

57. Conduct and/or participate in research 

58. Update clinical /professional knowledge/ skill 4.66 



G-13 




Doctorate 

N=44 

4.03 

4.03 

4.08 

4.03 

4.14 



4.44 

3.78 

3.93 



3.85 

3.60 

4.11 
3.88 
2 . 8^2 

3.B1 

3.65 



im 

4.64 



133 



Mean Importance Ratings ■ Geographic Region 
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Appendix H 



Mean Importance Ratings: Knowledge Areas 




H-1 




Mean Importance Ratines 
KNOWLEDGE AREAS 



Educator Supervisor Practitioner 

N=83 N=126 N=1192 



BASIC KNOWLETOE FOR EVALUATION AND TREATMENT 



1. 


professional codes of ethics 


4.45 


4.25 


4.23 


2. 


patient characteristics 


4.37 


4.17 


4.22 


3. 


aspects of human communication 


3.89 




iSi 


4. 


effects of hearing impairment 


4.37 


4.16 


4.25 


5. 


anatomy/physiology of various syst 


4.82 


4.64 


4.67 


6. 


pathophysiology of various systems 


4.80 


4.63 


4.61 


7. 


embryo logy/devel . of various systems 


4.30 


4.22 


4.17 


8. 


etiologic factors affecting various systems 


4.75 


4.57 


4.58 


9. 


normal devel. of speech and language 


4.27 


3.98 


4.11 


10. 


normal devel. of auditory behavior /function 


4.70 


4.52 


4.60 


11. 


normal processes of speech and language 


4.04 


3.78 


3.83 


12. 


normal processes of auditory behavior 


4.59 


4.40 


4.49 


13. 


neuroanatomy and neurophysiology 


4.48 


4.13 


4.11 


14. 


psychoacoustics 


4.27 


3.98 


3.94 


15. 


cerumen management 




MM 


MM 


16. 


pharmacology 


fell 


IMS 


'IMS 


17. 


basic electronics 


sssi 


fell 




STIMULUS FACTORS 








[Acoustic] 








18. 


temporal/spectral/amplitude chrctrstc of snds 


4.40 


4.00 


4.00 


19. 


Effects of propagation and transmission 


4.41 


4.06 


4.04 


20. 


sound analysis and quantification 


4.57 


4.11 


4.03 


[Non~ Acoustic ] 








21. 


physical characteristics of non-acoustic stim 


iMi 


li?l 


-Mil 


22. 


Effect of the delivery medium or system 


3.72 


3.56 


3.60 


23. 


non-audit ory stimulus analysis 


3.53 


HH 


3.52 


METHODS 








24 . 


Hearing Screening 


4.77 


4.58 


4.63 




a. Behavioral (VRA, etc. ) 


4.73 


4.73 


4.73 




b. Objective (ABR, OAE, OAES, etc) 


4.74 


4.71 


4.66 




c. Written (high risk register, etc) 


4.49 


4.39 


4.37 


25. 


Speech-Language Screening 


3.58 


ISIS 


IvU 




a. Formal 


MM 




Mm 




b. Informal 


3.68 






26. 


Consultation 


4.05 


3.96 


4.00 


27. 


Prevention 


4.41 


4.19 


4.39 


28. 


Counseling 


4.58 


4.60 


4.62 




a. Informational 


4.60 


4.52 


4.54 




b. Affective 


4.41 


4.40 


4.46 



H-3 



o 




IIW 03)]?y AVAILABLE 



29 . 



Basic Audiologic Assessment 

a . Behavioral (pure tone , speech , etc) 

b. Objective ( immittance, etc) 

c. Self-assessment inventories 

30. Pediatric Audiologic Assessment 

a. Behavioral 

b. Objective 

31. Comprehensive Audiologic Assessment 

a. Sensory vs. Neural 

b. Central auditory nervous system disorders 

c. Pseudohypacusis 

d. Tinnitus 

32. Electrodiagnostic Test Procedures (non-audtry) 

33. Auditory Evoked Potential Assessment 

a. Ecoch G 

b. ABR 

c. Middle 

d. Late 

e. Event-related/auditory-cognitive potential 

34. Neurophysiologic Intraoperative Monitoring 

a. Auditory 

b. Non-auditory 

c. Effects of anesthesia /pharmacological agents 

35. Balance System Assessment 

a. ENG 

b. Rotational-chair 

c. Posturography 

36. Hearing Conservation 

a. Occupational 

b. Non-occupational 

c. Ototoxic agents 

37. Audiological Rehabilitation Assessment 

a. Pediatric 

b. Adult 

c. Geriatric 

38. Audiological Rehabilitation 

a. Pediatric 

b. Adult 

c. Geriatric 

d. Alternative communication modes /systems 

e. Balance function rehabilitation 



lucator 


Supervisor 


Practitioner 


N»83 


NsX26 


N=*1192 


4.95 


4.95 


4.96 


4.94 


4.94 


4.96 


4.93 


4.94 


4.94 


4.26 


3.95 


3.93 


4.91 


4.86 


4.89 


4.89 


4.87 


4.87 


4.89 


4.85 


4.86 


4.94 


4.91 


4.87 


4.91 


4.87 


4.75 


4.33 


4.38 


4.25 


4.61 


4.59 


4.52 


4.12 


4.36 


4.28 


4.15 


4.21 


4.13 


4.79 


4.62 


4.52 


3.86 


3.88 


3.66 


4.83 


4.71 


4.58 


3.77 


3.71 


3.56 


igi 


3.62 






3.50 


IWi 


fils 

IS 


iffli 


■ 




ill 


Hi 


4.04 


4.10 


4.06 


3.98 


4.07 


4.06 


& 


3 41 


IM 






IBl 


4.25 


4.22 


4.29 


4.20 


4.20 


4.26 


4.11 


4.15 


4.21 


4.24 


4.35 


4.32 


4.70 


4.50 


4.53 


4.75 


4.49 


4.58 


4.66 


4.46 


4.51 


4.67 


4.47 


4.52 


4.50 


4.08 


4.16 


4.55 


4.13 


4.24 


4.46 


4.09 


4.15 


4.47 


4.12 


4.15 


4.04 


3.73 


3.79 


^2 


3 3^13 


3-;31 




H-4 







Educator 


Supervisor 


Practitioner 






N°83 


Nsl26 


N31192 


39. 


Product Dispensing 


4.83 


4.77 


4.78 




a. Hearing aids 


4.90 


4.81 


4.80 




b. Assistive devices 


4.71 


4.56 


4.50 




c. Cochlear implant processors 


3.99 


3.74 


3.60 




d. Tinnitus maskers 


3S2(7i 


3.52 


3^30 




e. Tactile/sensory devices 


fell 


sMS 






f. Earmold impressions 


4.83 


4.79 


4.83 


40. 


Product/Repair Modification 


4.16 


4.37 


4.41 


41. 


Hearing Aid Assessment 


4.85 


4.79 


4.80 




a. Developmentally appropriate behavioral testin 


4.78 


4.65 


4.70 




b. Real-ear measurement 


4.72 


4.52 


4.46 




c. Electroacoustic evaluation 


4.80 


4.60 


4.53 




d. Determination of earmold characteristics 


4.78 


4.65 


4.61 




e. Administration of communication inventories 


4.20 


3.59 


3.50 


42. 


Assistive Listening System/Device Selection 


4.39 


4.20 


4.14 


43. 


Sensory Aids Assessment (e.g., tactile aids) 


3.61 


3.53 


3.50 


44. 


Hearing Aid Fitting/Orientation 


4.84 


4.84 


4.82 




a. Behavioral 


4.72 


4.69 


4.66 




b. Real-ear measurments 


4.77 


4.55 


4.50 




c. Earmold modification 


4.73 


4.69 


4.64 




d. Self-assessment inventories 


4.22 


3.82 


3.66 




e. Counseling/rehcibilitation 


4.74 


4.73 


4.69 


45. 


Sensory Aids Fitting/Orientation 


3.71 


3.50 


WM 


46. 


Electrical Stimulation for Cochlear Implant 


3.58 






47. 


Implant Selection euid Rehaibilitation 


3.53 






TEST 


ANALYSIS 








48. 


Statistical Principles. 


3.71 




mi 




a. Parametric 


3.66 




ini 




b. Non-parametric 


3.54 


iHI 


Slo 




c. Clinical decision analysis 


4.00 




liH 


KNOWI.EDGE FOR REUITED PROFESSIONAL ACTIVITIES 








[Legislative] 








49. 


legislation/regulation relevant to the profession 


4.07 


3.79 


3.79 


50. 


rights of patient/consumer 


4.33 


4.26 


4.25 


51. 


sales of hearing aids 


4.24 


4.27 


4.25 


52. 


workers ' compensation 


3.66 


3.62 


3.54 


53. 


noise exposure and hearing conservation 


4.22 


4.17 


4.20 


54. 


public laws related to clinical practice 


4.34 


4.27 


4.18 


55. 


state-licensure /regulation 


4.44 


4.39 


4.36 



H-5 








Educator 


Supervisor 


Practitioner 






N»83 


N»126 


N>1192 


[Administrative] 








56 . 


third-party reimbursement 


3.95 


3.66 


3.60 


57 . 


quality improvement techniques 


3.84 


3.70 


3.61 


58 . 


safety and health/universal precautions 


4.28 


4.31 


4.29 


59 . 


calibration standards, documentation, procedures 


4.34 


4.06 


3.96 


60 . 


pr o f e s s i ona 1 s t andards / accr edi t a t i on 


4.21 


4.18 


4.09 


61 . 


human resources management 


alii 


WM 






H-6 




Appendix I 



Mean Importance Ratings: Knowledge Areas -- Practitioner Subgroups 




1-1 



Mean Importance Ratings « Gender 
KNOWLEDGE AREAS 



Male Female 

N=180 N=1009 



BASIC KNOWLEDGE FOR EVALUATION AND TREATMENT 



1. 


professional codes of ethics 


4.15 


4.25 


2. 


patient characteristics 


4.16 


4.23 


3. 


aspects of human communication 




3iit:ii 


4. 


effects of hearing impairment 


4 . 18 


4.27 


5. 


anatomy/physiology of various syst 


4.69 


4.67 


6. 


pathophysiology of various systems 


4.68 


4.60 


7 . 


embryo 1 ogy / devel . of various systems 


4.07 


4.18 


8. 


etiologic factors affecting various systems 


4.60 


4.58 


9. 


normal devel. of speech and language 


4.02 


4.12 


10. 


normal devel. of auditory behavior/ function 


4.62 


4.60 


11. 


normal processes of speech and language 


3.70 


3.86 


12. 


normal processes of auditory behavior 


4.50 


4.49 


13 . 


neuroanatomy and neurophysiology 


4.26 


4.08 


14. 


psychoacous tics 


4.22 


3.89 


15. 


cerumen management 


3.81 




16. 


pharmacology 


WM 


ISil 


17. 


basic electronics 


isli 





STIMULUS FACTORS 



[Acoustic] 

18. temporal /spectral /amplitude chrctrstc of snds 

19. Effects of propagation and transmission 

20. sound analysis and quantification 

[Non~Acoust ic ] 

21. physical characteristics of non-acoustic stim 

22. Effect of the delivery medium or system 

23. non-auditory stimulus analysis 

METHODS 

24. Hearing Screening 

a . Behavioral ( VRA, etc . ) 

b. Objective (ABR, OAE, OAES, etc) 

c. Written (high risk register, etc) 

25. Speech-Language Screening 

a . Formal 

b. Informal 

26. Consultation 

27. Prevention 

Counseling 
a. Informational 



4.31 


3.95 


4.27 


4.00 


4.27 


3.99 







3.75 


3.58 


3.66 





4.51 


4.66 


4.63 


4.75 


4.69 


4.65 


4.23 


4.40 


iMi. 


3jMX 

liS 


4.00 


4.00 


4.39 


4.39 


4.54 


4.63 


4.41 


4.56 



28 . 









Male 


Female 








NslSO 


N=^1009 


29. 


Basic Audiologic Assessment 


4.96 


4.96 




a. 


Behavioral (pure tone, speech, etc) 


4.94 


4.96 




b. 


Objective (immittance, etc) 


4.94 


4.94 




c . 


Self-assessment inventories 


3.92 


3.93 


30. 


Pediatric Audiologic Assessment 


4.85 


4.89 




a. 


Behavioral 


4.82 


4.88 




b. 


Objective 


4.85 


4.86 


31. 


Comprehensive Audio logic Assessment 


4.93 


4.86 




a. 


Sensory vs. Neural 


4.83 


4.74 




b. 


Central auditory nervous system disorders 


4.36 


4.23 




c . 


Pseudohypacusis 


4.52 


4.52 




d. 


Tinnitus 


4.27 


4.28 


32. 


Electrodiagnostic Test Procedures (non-audtry) 


4.19 


4.12 


33 . 


Auditory Evoked Potential Assessment 


4.65 


4.49 




a. 


Ecoch G 


3.86 


3.62 




b. 


ABR 


4.67 


4.57 




c . 


Middle 


3.79 


3.52 




d. 


Late 


3.60 






e. 


Event-related/ auditory-cognitive potential 


3 : 4 6 




34. 


Neurophysiologic Intraoperative Monitoring 


3v:3| 






a. 


Auditory 


3.53 






b. 


Non-auditory 


tMi 






c . 


Effects of anesthesia/pharmacological agents 


3.56 




35. 


Balance System Assessment 


4.08 


4.06 




a. 


ENG 


4.07 


4.05 




b. 


Rotational -chair 








c . 


Posturography 


SM 


si 


36. 


Hearing Conservation 


4.40 


4.27 




a. 


Occupational 


4.38 


4.23 




b. 


Non-occupational 


4.27 


4.20 




c . 


Ototoxic agents 


4.42 


4.30 


37. 


Audiological Rehabilitation Assessment 


4.60 


4.52 




a. 


Pediatric 


4.60 


4.57 




b. 


Adult 


4.56 


4.50 




c . 


Geriatric 


4.57 


4.51 


38. 


Audiological Rehabilitation 


4.11 


4.17 




a. 


Pediatric 


4.20 


4.25 




b. 


Adult 


4.15 


4.15 




c . 


Geriatric 


4.19 


4.15 




d. 


Alternative communication modes/ systems 


3.74 


3.80 




e . 


Balance function rehabilitation 


3 -11 






1-4 



Male 

N=180 



39. Product Dispensing 

a. Hearing aids 

b. Assistive devices 

c. Cochlear implant processors 

d. Tinnitus maskers 

e. Tactile/sensory devices 

f. Earmold impressions 



4.79 

4.80 
4.49 
3.70 

4.83 



40. Product /Repair Modification 

41. Hearing Aid Assessment 

a. Development ally appropriate behavioral testin 

b. Real-ear measurement 

c. Electroacoustic evaluation 

d. Determination of earmold characteristics 

e. Administration of communication inventories 



4.49 

4.81 

4.64 

4.58 

4.62 
4.67 

3.63 



42. Assistive Listening System/Device Selection 

43. Sensory Aids Assessment (e.g., tactile aids) 



44. Hearing Aid Fitting/Orientaticn 

a. Behavioral 

b. Real-ear measurments 

c. Earmold modification 

d. Self-assessment inventories 

e. Counseling/rehabilitation 



4.84 

4.65 

4.66 
4.72 
3.74 

4.67 



45. Sensory Aids Fitting/Orientation 

46. Electrical Stimulation for Cochlear Implant 

47. Implant Selection and Rehabilitation 



3.51 

wM 



TEST ANALYSIS 

48. Statistical Principles. 

a. Parametric 

b. Non-parametric 

c. Clinical decision analysis 

knowledge for related professional activities 



IMi 

^1 

ImI 



[Legislative] 

49. legislation/regulation relevant to the profession 

50. rights of patient /consumer 

51. sales of hearing aids 

52 . workers ' compensation 

53 . noise exposure and hearing conservation 

54. public laws related to clinical practice 

55. state-licensure/regulation 



3.94 

4.27 

4.32 
3.61 

4.33 
4.29 
4.37 




1-5 



Female 

N=>1009 

4.78 

4.80 

4.50 

3.58 

4.83 

4.39 

4.80 

4.71 

4.44 

4.52 

4.60 

WWi 

4.14 

3.50 

4.82 

4.66 

4.48 

4.62 

3.65 

4.69 



iSi 

isi 

ss 



3 .76 
4.25 
4.24 
3.53 
4.18 
4.16 
4.36 



Male 

N=180 

[Administrative] 



56. third-party reimbursement 4.01 

57. quality improvement techniques 3.84 

58. safety and health/universal precautions 4.28 

59. calibration standards, documentation, procedures 4.12 

60. professional standards/accreditation 4.11 

61. human resources management 




1-6 



Female 

N»1009 



3.52 

3.56 

4.29 

3.94 

4.09 



Mean Importance Ratings • Race/Ethnicitv 
KNOWLEDGE AREAS 



White Non 

N=1126 

BASIC KNOWLEDGE FOR EVALUATION AND TREATMENT 



1. professional codes of ethics 4.23 

2. patient characteristics 4.21 

3. aspects of human communication 

4. effects of hearing impairment 4.25 

5. anatomy/physiology of various syst 4.67 

6. pathophysiology of various systems 4.60 

7. embryo 1 ogy / deve 1 . of various systems 4.15 

8. etiologic factors affecting various systems 4.58 

9. normal devel. of speech and language 4.10 

10. normal devel. of auditory behavior/ function 4.60 

11. normal processes of speech and language 3.83 

12. normal processes of auditory behavior 4.48 

13. neuroanatomy and neurophysiology 4.10 

14. psychoacoustics 3.93 

15. cerumen management ' 

16. pharmacology 

17. basic electronics 



STIMULUS FACTORS 
[Acoustic] 



18. temporal /spectral /amplitude chrctrstc of snds 3.99 

19. Effects of propagation and transmission 4.03 

20. sound analysis and quantification 4.03 

[Non-Acoust ic ] 

21. physical characteristics of non-acoustic stim ^?2,Q 

22. Effect of the delivery medium or system 3.59 

23. non-auditory stimulus analysis 3.51 

METHODS 

24. Hearing Screening 4.64 

a. Behavioral (VRA, etc . ) 4.73 

b. Objective (ABR, OAE, OAES, etc) 4.65 

c. Written (high risk register, etc) 4.37 

25. Speech-Language Screening 

a. Formal 

b . In forma 1 3 ; .;4 5 

26. Consultation 3.99 

27. Prevention 4.39 

28. Counseling 4.62 

a. Informational 4.54 

b. Affective 4.46 



1-7 




150 



'White 

N=57 



4.32 

4.35 

3.67 
4.30 
4.78 
4.71 
4.43 

4.68 
4.25 
4.70 
4.02 
4.61 
4.22 
4.18 

Hi 

lill 



4.12 
4.18 

4.13 



1131 

3.92 

3.67 



4.53 

4.69 

4.72 

4.42 

3.50 

4.19 

4.36 

4.57 

4.52 

4.40 



29 . 



Basic Audiologic Assessment 

a . Behavioral (pure tone , speech , etc ) 

b. Objective (immittance, etc) 

c. Self-assessment inventories 

30. Pediatric Audiologic Assessment 

a. Behavioral 

b . Obj ective 

31. Comprehensive Audiologic Assessment 

a. Sensory vs. Neural 

b. Central auditory nervous system disorders 

c. Pseudohypacusis 

d. Tinnitus 

32. Electrodiagnostic Test Procedures (non-audtry) 

33. Auditory Evoked Potential Assessment 

a. Ecoch G 

b. ABR 

c . Middle 

d. Late 

e. Event-related/auditory-cognitive potential 

34. Neurophysiologic Intraoperative Monitoring 

a. Auditory 

b. Non-auditory 

c. Effects of anesthesia/pharmacological agents 

35. Balance System Assessment 

a. ENG 

b. Rotational-chair 

c. Posturography 

36. Hearing Conservation 

a. Occupational 

b. Non-occupational 

c . Ototoxic agents 

37. Audiological Rehab>ilitation Assessment 

a. Pediatric 

b. Adult 

c. Geriatric 

38. Audiological Rehabilitation 

a. Pediatric 

b. Adult 

c. Geriatric 

d. Alternative communication modes /systems 

e. Balance function rehabilitation 



White 


Non-Vfhite 


N=1126 


N«57 


4.96 


4.94 


4.96 


4.91 


4.94 


4.95 


3.93 


4.00 


4.89 


4.87 


4.87 


4.82 


4.85 


4.89 


4.87 


4.90 


4.75 


4.76 


4.24 


4.29 


4.52 


4.52 


4.29 


4.15 


4.13 


4.31 


4.51 


4.65 


3.65 


3.80 


4.58 


4.67 


3.55 


3.79 


IS 


3.70 


gffl 




:Q1 


3^:47 






iiS 






3.61 


4.06 


4.12 


4.05 


4.10 










4.28 


4.31 


4.26 


4 . 19 


4.22 


4.09 


4.31 


4.38 


4.52 


4.73 


4.57 


4.60 


4.50 


4 . 64 


4.51 


4.67 


4.15 


4.28 


4.24 


4.33 


4.14 


4.28 


4.15 


4.26 


3.78 


3.88 




3.52 



1-8 



151 

BEST COPT AVAIL4BIE 

/ 







White 


Non-> White 






N*1126 


N=57 


39. 


Product Dispensing 


4.78 


4.71 




a. Hearing aids 


4.81 


4.74 




b. Assistive devices 


4.50 


4.48 




c . Cochlear implant processors 


3.59 


3.67 




d. Tinnitus maskers 


3.-. 2 9 






e. Tactile/sensory devices 


WWs 


3.53 




f. Earmold impressions 


4.83 


4.77 


40. 


Product/Repair Modification 


4.40 


4.45 


41. 


Hearing Aid Assessment 


4.80 


4.78 




a. Developmentally appropriate behavioral testin 


4.69 


4.81 




b. Real-ear measurement 


4.45 


4.52 




c. Electroacoustic evaluation 


4.53 


4.56 




d. Determination of earmold characteristics 


4.61 


4.57 




e. Administration of communication inventories 


3.50 


3.55 


42 . 


Assistive Listening System/Device Selection 


4.14 


4.00 


43. 


Sensory Aids Assessment (e.g., tactile aids) 




3.79 


44. 


Hearing Aid Fitting/Orientation 


4.83 


4.76 




a. Behavioral 


4.67 


4.50 




b. Real-ear measurments 


4.50 


4.57 




c. Earmold modification 


4.64 


4.55 




d. Self-assessment inventories 


3.66 


3.81 




e. Counseling/rehabilitation 


4.68 


4.70 


45. 


Sensory Aids Fitting/Orientation 


BH 


3.67 


46. 


Electrical Stimulation for Cochlear Implant 


hH 




47. 


Implcint Selection cind Rehabilitation 


WM 




TEST 


ANALYSIS 






48. 


Statistical Principles. 


2WB 






a. Paraunetric 








b. Non-par cune trie 


§kM 






c. Clinical decision analysis 




Sal 


KNOWI.EDGE FOR RELATED PROFESSIONAL ACTIVITIES 






[Legislative] 






49. 
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Mean Importance Ratings ■ Years Certified 
KNOWLEDGE AREAS 







< = 5 


> 5 






N=341 


N=847 


BASIC KNOWLEDGE FOR EVALUATION AND TREATMENT 






1. 


professional codes of ethics 


4.29 


4.21 


2. 


patient characteristics 


4.24 


4.20 


3. 


aspects of human communication 






4. 


effects of hearing impairment 


4.27 


4.25 


5. 


anatomy/ physiology of various syst 


4.65 


4.69 


6. 


pathophysiology of various systems 


4.56 


4.63 


7. 


embryo 1 ogy / deve 1 . of various systems 


4.11 


4.19 


8. 


etiologic factors affecting various systems 


4.54 


4.61 


9. 


normal devel. of speech and language 


4.08 


4.12 


10. 


normal devel. of auditory behavior/ function 


4.56 


4.62 


11. 


normal processes of speech and language 


3.75 


3.87 


12. 


normal processes of auditory behavior 


4.45 


4.50 


13. 


neuroanatomy and neurophysiology 


4.03 


4.14 


14. 


psychoacoustics 


3.82 


3.99 


15. 


cerumen management 






16. 


pharmacology 




fill 


17. 


basic electronics 







STIMULUS FACTORS 
[Acoustic] 



18. 


temporal/spectral/amplitude chrctrstc of snds 


3.96 


4.02 


19. 


Effects of propagation and transmission 


3.98 


4.06 


20. 


sound analysis and quantification 


3.96 


4.05 


[Non-Acoustic I 






21. 


physical characteristics of non-acoustic stim 


SSI 




22. 


Effect of the delivery medium or system 


3.61 


3.60 


23. 


non-auditory stimulus analysis 


3ijp 


3.54 



METHODS 



24. 


Hearing Screening 


4.63 


4.63 




a. Behavioral (VRA, etc.) 


4.75 


A, 12 




b. Objective (ABR, OAE, OAES, etc) 


4.72 


4.63 




c. Written (high risk register, etc) 


4.43 


4.35 


25. 


Speech-Language Screening 




11^ 




a. Formal 




ilM 




b. Informal 




iiii 


26. 


Consultation 


4.02 


3.99 


27. 


Prevention 


4.42 


4.38 


28. 


Counseling 


4.62 


4.61 




a. Informational 


4.53 


4.54 




b. Affective 


4.48 


4.45 




1-16 



4 



29 . 



< = 5 
N=341 



Basic Audiologic Assessment 

a. Behavioral (pure tone, speech, etc) 

b. Objective (immittance, etc) 

c. Self-assessment inventories 

30. Pediatric Audiologic Assessment 

a . Behavioral 

b. Objective 

31. Comprehensive Audiologic Assessment 

a. Sensory vs. Neural 

b. Central auditory nervous system disorders 

c. Pseudohypacusis 

d. Tinnitus 

32. Electrodiagnostic Test Procedures (non-audtry) 



33. 



Auditory Evoked Potential Assessment 

a. Ecoch G 

b. ABR 

c . Middle 

d. Late 

e . Event-related/ auditory-cognitive potential 

Neurophysiologic Intraoperative Monitoring 

a. Auditory 

b. Non-auditory 

c. Effects of anesthesia /pharmacological agents 

Balance System Assessment 

a. ENG 

b. Rotational-chair 

c. Posturography 

Hearing Conservation 

a. Occupational 

b. Non-occupational 

c. Ototoxic agents 



37. Audiological Rehabilitation Assessment 

a. Pediatric 

b. Adult 

c. Geriatric 

38. Audiological Rehabilitation 

a. Pediatric 

b. Adult 

c . Geriatric 

d. Alternative communication modes /systems 

e. Balance function rehabilitation 



34. 



35. 



36. 



4.96 

4.96 

4.94 

3.78 

4.89 

4.87 

4.84 

4.87 

4.71 

4.19 

4.49 

4.26 

4.25 

4.55 

3.56 
4.66 

WM: 

liii 

4.07 

4.05 

usi 

ils 

4.32 

4.23 
4.21 
4.27 

4.53 

4.59 

4.49 

4.50 

4.17 

4.24 
4.13 
4.15 
3.81 
3S3l 



M7 



ERIC 



> 5 
N=847 

4.96 

4.96 

4.94 

3.99 

4.89 

4.87 

4.87 

4.86 

4.77 

4.27 

4.54 
4.29 

4.09 

4.50 

3.69 

4.55 
3.64 

3.56 

ISi 

m 

:lsi 

Hli 

4.05 

4.06 

WM 

1511 

4.27 

4.27 

4.22 

4.34 

4.54 

4.57 

4.52 

4.53 

4.16 

4.24 

4.15 

4.16 
3.78 



< = 5 
Nr:=341 



39 . Product Dispensing 



a . 


Hearing aids 


4.85 


b. 


Assistive devices 


4.54 


c . 


Cochlear implant processors 


3.59 


d. 


Tinnitus maskers 


3??-?i 


e . 


Tactile/sensory devices 


iW' 


f . 


Earmold impressions 


4.84 



40. Product/Repair Modification 



4.50 



41. Hearing Aid Assessment 

a. Developmentally appropriate behavioral testin 

b. Real -ear measurement 

c. Electroacoustic evaluation 

d. Determination of earmold characteristics 

e. Administration of communication inventories 



4.84 

4.71 

4.49 

4.59 

4.65 

3 Ms 



42. Assistive Listening System/Device Selection 

43. Sensory Aids Assessment (e.g., tactile aids) 



44. Hearing Aid Fitting/Orientation 

a. Behavioral 

b. Real -ear measurments 

c. Earmold modification 

d. Self-assessment inventories 

e. Counseling/ rehabilitation 



4.87 

4.68 

4.55 

4.66 

3.53 

4.74 



45. Sensory Aids Fitting/Orientation 

46. Electrical Stimulation for Cochlear Implant 

47. Implant Selection and Rehabilitation 



3.51 

ISl 

US 



TEST ANALYSIS 

48. Statistical Principles. 

a. Parametric 

b. Non-parametric 

c. Clinical decision analysis 

KNOWLEDGE FOR RELATED PROFESSIONAL ACTIVITIES 



Mbs 

IS 

IsH 

SMS 



[Legislative] 

49. legislation/regulation relevant to the profession 

50. rights of patient/consumer 

51. sales of hearing aids 

52 . workers ' compensation 

53. noise exposure arid hearing conservation 

54. public laws related to clinical practice 

55. state-licensure/regulation 



3.89 

4.32 

4.28 

3.55 

4.26 

4.20 

4.39 




1-18 




> 5 
N=847 

4.76 

4.79 
4.48 
3.60 

3;ii 
3 Ml 

4.82 

4.37 

4.78 

4.69 

4.44 

4.51 

4.59 

3.54 

4.09 

3,^M 

4.80 

4.65 
4.48 
4.63 
3.72 

4.66 

SSI 



Sill 

IEI.1 



3.75 

4.22 

4.24 

3.54 

4.17 

4.17 

4.35 



[Administrative] 



< = 5 
M=:341 



> 5 
N=847 



56. third-party reimbursement 3.57 

57. quality improvement techniques 3.65 

58. safety and health/universal precautions 4.27 

59. calibration standards, documentation, procedures 3.88 

60. professional standards/accreditation 4.19 

61. human resources management 3 ::-2‘4 




1-19 



3.61 

3.58 

4.30 

4.00 

4.05 

3^11 



Mean Importance Ratines • Highest Educational Level 
KNOWLEDGE AREAS 







Master 


Doctorate 






N=1148 


N-44 


BASIC KNOWLEDGE FOR EVALUATION AND TREATMENT 






1. 


professional codes of ethics 


4.24 


4.20 


2. 


patient characteristics 


4.21 


4.34 


3. 


aspects of human communication 


IMS 


3.55 


4. 


effects of hearing impairment 


4.25 


4.38 


5. 


anatomy /physiology of various syst 


4.67 


4.70 


6. 


pathophysiology of various systems 


4.60 


4.75 


7 . 


embryo logy / deve 1 . of various systems 


4.17 


4.07 


8. 


etiologic factors affecting various systems 


4.58 


4.77 


9. 


normal devel. of speech and language 


4.11 


4.11 


10. 


normal devel. of auditory behavior/ function 


4.60 


4.61 


11. 


normal processes of speech and language 


3.84 


3.79 


12. 


normal processes of auditory behavior 


4.49 


4.58 


13. 


neuroanatomy and neurophysiology 


4.09 


4.41 


14. 


psychoacoustics 


3.93 


4.36 


15. 


cerumen management 




3.69 


16. 


pharmacology 


IIP; 




17. 


basic electronics 


IS 


3.51 


STIMULUS FACTORS 






[Acoustic] 






18. 


temporal /spectral /amplitude chrctrstc of snds 


3.99 


4.27 


19. 


Effects of propagation and transmission 


4.02 


4.36 


20. 


sound analysis and quantification 


4.01 


4.57 


[Non* 


Acoustic] 






21. 


physical characteristics of non-acoustic stim 


ilH 


3.56 


22. 


Effect of the delivery medium or system 


3.59 


3.95 


23 . 


non-auditory stimulus analysis 


3.50 


3.86 


METHODS 






24. 


Hearing Screening 


4.63 


4.62 




a. Behavioral (VRA, etc. ) 


4.74 


4.53 




b. Objective (ABR, OAE, OAES, etc) 


4.66 


4.63 




c. Written (high risk register, etc) 


4.38 


4.21 


25. 


Speech-Language Screening 


3V36 






a . Formal 


2 -91 


3^ 




b. Informal 




3.59 


26. 


Consultation 


4.00 


3.95 


27. 


Prevention 


4.40 


4.19 


28. 


Counseling 


4.62 


4.62 




a. Informational 


4.54 


4.53 




b. Affective 


4.46 


4.40 









Master 


Doctorate 








N=1148 


N=44 


29. 


Basic Audi ©logic Assessment 


4.96 


4.98 




a . 


Behavioral (pure tone, speech, etc) 


4.96 


4.98 




b. 


Objective (immittance, etc) 


4.94 


4.95 




c . 


Self-assessment inventories 


3.92 


4 . 12 


30. 


Pediatric Audiologic Assessment 


4.89 


4.90 




a . 


Behavioral 


4.87 


4.86 




b. 


Objective 


4.85 


4.95 


31. 


Comprehensive Audi ©logic Assessment 


4.86 


4.95 




a . 


Sensory vs . Neural 


4.75 


4.90 




b. 


Central auditory nervous system disorders 


4.24 


4.41 




c . 


Pseudohypacusis 


4.51 


4.70 




d. 


Tinnitus 


4.28 


4.20 


32. 


Electrodiagnostic Test Procedures (non-audtry) 


4.14 


3.90 


33. 


Auditory Evoked Potential Assessment 


4.51 


4.69 




a. 


Ecoch G 


3.64 


3.92 




b. 


ABR 


4.58 


4.66 




c . 


Middle 


3.55 


3.88 




d. 


Late 


WM 


3.67 




e. 


Event-related/auditory-cognitive potential 


wM 


3.64 


34. 


Neurophysiologic Intraoperative Monitoring 


MS 


Sii 




a. 


Auditory 


imI 


IMl 




b. 


Non-auditory 


im 






c . 


Effects of anesthesia/pharmacological agents 


isil 


iSl 


35. 


Balance System Assessment 


4.06 


4.00 




a. 


ENG 


4.06 


4.02 




b. 


Rotational -chair 




3.62 




c . 


Po s tur ogr aphy 


tMi 


3.55 


36. 


Hearing Conservation 


4.28 


4.38 




a. 


Occupational 


4.25 


4.30 




b. 


Non-occupational 


4.22 


4.16 




c . 


Ototoxic agents 


4.32 


4.42 


37. 


Audiological Rehabilitation Assessment 


4.53 


4.61 




a. 


Pediatric 


4.58 


4.61 




b. 


Adult 


4.51 


4.59 




c . 


Geriatric 


4.52 


4.59 


38. 


Audiological Rehabilitation 


4.15 


4.26 




a. 


Pediatric 


4.24 


4.20 




b. 


Adult 


4.14 


4.16 




c . 


Geriatric 


4.15 


4.20 




d. 


Alternative communication modes /systems 


3.79 


3.66 




e . 


Balance function rehabilitation 




3,44 



o 




1-21 







Master 


Doctorate 






N=1148 


N=44 


39. 


Product Dispensing 


4.78 


4.83 




a. Hearing aids 


4.80 


4.80 




b. Assistive devices 


4.50 


4.42 




c. Cochlear implant processors 


3.58 


4.00 




d. Tinnitus maskers 




3.58 




e. Tactile/sensory devices 


■3>:3j 


3.66 




f. Earmold impressions 


4.82 


4.86 


40. 


Product /Repair Modification 


4.40 


4.49 


41. 


Hearing Aid Assessment 


4.80 


4.90 




a. Development ally appropriate behavioral testin 


4.70 


4.67 




b. Real -ear measurement 


4.45 


4.73 




c. Electroacoustic evaluation 


4.53 


4.75 




d. Determination of earmold characteristics 


4.60 


4.77 




e. Administration of communication inventories 




3.93 


42. 


Assistive Listening System/Device Selection 


4.14 


4.20 


43. 


Sensory Aids Assessment (e.g., tactile aids) 




3.67 


44. 


Hearing Aid Fitting/Orientation 


4.82 


4.93 




a. Behavioral 


4.66 


4.70 




b. Real-ear measurments 


4.49 


4.77 




c. Earmold modification 


4.63 


4.86 




d. Self-assessment inventories 


3.65 


4.07 




e . Counseling/rehabilitation 


4.68 


4.75 


45. 


Sensory Aids Fitting/Orientation 


3i46 


3.67 


46. 


Electrical Stimulation for Cochlear Implant 


IIP' 


3.55 


47. 


Implcint Selection and Rehabilitation 


fSI 


3.56 


TEST 


ANALYSIS 






48. 


Statistical Principles. 




3.52 




a. Parametric 




3.50 




b. Non-parametric 








c. Clinical decision analysis 




3.86 


KNOWLEDGE FOR REUVTED PROFESSIONAL ACTXVXTXES 






[Legislative] 






49. 


legislation/regulation relevant to the profession 


3.78 


3.93 


50. 


rights of patient /consumer 


4.25 


4.14 


51. 


sales of hearing aids 


4.25 


4.12 


52. 


workers ’ compensation 


3.54 


■ 3.67 


53. 


noise exposure and hearing conservation 


4.20 


4.07 



1-22 



Master 

N-1148 



Doctorate 

N:::44 



54. public laws related to clinical practice 4.18 

55. state-licensure/regulation 4.37 

CAdministrative] 

56. third-party reimbursement 3.58 

57. quality improvement techniques 3.60 

58. safety and health/universal precautions 4.29 

59. calibration standards, documentation, procedures 3.95 

60. professional standards/accreditation 4.09 

61. human resources management 



1-23 




4.09 

4.21 



3.86 

3.71 

4.23 

4.30 

4.05 

£11 



Mean Importance Ratings - Geographic Region 
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Definitions of Scale Anchors 



Where Learned 

1 School - Classroom 

2 School - Practicum 

3 Clinical fellowship 

4 On the j ob, after certification 

5 Continuing education, after certification 
Where Should Be Learned 

1 School - Classroom 

2 School - Practicum 

3 Clinical fellowship 

4 On the job, after certification 

5 Continuing education, after certification 
Discrepancy Scores 

-3 Although learned in school, should be learned after certification 

-2 Although learned in school, should be learned during the clinical fellowship 

-1 Although learned during the clinical fellowship, should be learned after certification 
0 Is being learned where it should be learned 
+1 Although learned after certification, should be learned during the clinical fellowship 
+2 Although learned during the clinical fellowship, should be learned in school 
+3 Although learned after certification, should be learned in school 
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Appendix K 



Discrepancy Scores: Clinical Activity Statements 
(Number of Years Certification) 



K-1 
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Definitions of Scale Anchors 



Where Learned 

1 School - Classroom 

2 School - Practicum 

3 Clinical fellowship 

4 On the job, after certification 

5 Continuing education, after certiftcation 
Where Should Be Learned 

1 School - Qassroom 

2 School - Practicum 

3 Ginical fellowship 

4 On the job, after certification 

5 Continuing education, after certification 
Discrepancy Scores 

•3 Although learned in school, should be learned after certification 

*2 Although learned in school, should be learned during the clinical fellowship 

* I Although learned during the clinical fellowship, should be learned after certification 
0 Is being learned >^ere it should be learned 
+1 Although learned after certification, should be learned during the clinical feUowship 
+2 Although learned during the clinical fello'jvship, should be learned in school 
+3 Although learned after certification, should be learned in school 
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CLINICAL ACTIVITY STATEMENTS 
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Appendix L 



Discrepancy Scores: Knowledge Areas 



Definitions of Scale Anchors 



Where Learned 

1 School - Classroom 

2 School - Practicum 

3 Clinical fellowship 

4 On the job, after certification 

5 Continuing education, after certification 
Where Should Be Learned 

1 School - Classroom 

2 School - Practicum 

3 Clinical fellowship 

4 On the job, after certification 

5 Continuing education, after certification 
Discrepancy Scores 

-3 Although acquired in school, should be acquired after certification 
-2 Although acquired in school, should be acquired during the clinical fellowship 
-1 Although acquired during the clinical fellowship, should be acquired after certification 
0 Is being acquired where it should be acquired 
+1 Although acquired after certification, should be acquired during the clinical fellowship 
+2 Although acquired during the clinical fellowship, should be acquired in school 
+3 Although acquired after certification, should be acquired in school 



Discrepancy Scores - Practitioners 
KNOWLEDGE AREAS 
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Appendix M 



Discrepancy Scores: Knowledge Areas 
(Number of Years Certification) 



Deflnitions of Scale Anchors 



Where Learned 

1 School - Classroom 

2 School - Practicum 

3 Clinical fellowship 

4 On the job, after certification 

5 Continuing education, after certification 
Where Should Be Learned 

1 School - Classroom 

2 School Practicum 

3 Clinical fellowship 

4 On the job, after certification 

5 Continuing education, after certification 
Discrepancy Scores 

-3 Although acquired in school, should be acquired after certification 

-2 Although acquired in school, should be acquired during the clinical fellowship 

-1 Although acquired during the clinical fellowship, should be acquired after certification 
0 Is being acquired where it should be acquired 
+1 Although acquired after certification, should be acquired during the clinical fellowship 
+2 Although acquired during the clinical fellowship, should t*e acquired in school 

+3 Although acquired after certification, should be acquired in school 
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